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1  Overview 

1.1  Publications 

With  full  or  partial  support  from  Air  Force  STTR  contract  F49620-00-C- 
0039,  we  produced  (i)  contributions  to  three  books,  (ii)  six  articles  that 
have  been  -  or  are  slated  to  be  -  submitted  to  peer  reviewed  journals  and 
(iii)  a  software  manual  that  will  accompany  the  S+Wavelbts  software. 
The  contributions  to  books  are  the  following. 

1.  Wavelet  Methods  for  Time  Series  Analysis,  D.  B.  Percival  and  A.  T. 
Walden  (2000),  Cambridge,  England;  Cambridge  University  Press. 
The  theory  presented  in  this  book  formed  the  foundation  for  much 
of  the  research  and  software  developed  for  this  contract.  Topics  in¬ 
clude  wavelet  filter  families;  convolution  style  wavelet  transforms  in¬ 
cluding  the  discrete  wavelet  transform,  the  maximal  overlap  discrete 
wavelet  transform,  the  discrete  wavelet  packer  transform  and  the  max¬ 
imal  overlap  discrete  wavelet  packer  transform;  wavelet  variance  anal¬ 
ysis;  analysis  and  synthesis  of  long  memory  processes;  wavelet-based 
signal  estimation;  and  wavelet  analysis  of  finite  energy  signals. 

2.  ‘The  Impact  of  Wavelet  Coefficient  Correlations  on  Fractionally  Differ¬ 
enced  Process  Estimation’,  P.  F.  Craigmile,  D.  B.  Percival  and  P.  Gut- 
torp  (2001),  in  European  Congress  of  Mathematics  (Barcelona,  July 
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10-14,  2000),  Volume  II,  edited  by  C.  Casacuberta,  R.  M.  Miro-Roig, 
J.  Verdera  and  S.  Xambo-Descamps,  Basel,  Switzerland:  Birkhauser 
Verlag,  pp.  591-9.  Here  we  demonstate  that,  while  the  within-scale 
nonboundary  coefficients  of  the  discrete  wavelet  transform  of  a  frac¬ 
tionally  differenced  process  are  approximately  uncorrelated,  the  re¬ 
maining  weak  correlation  between  these  coefficients  is  well  modeled 
by  a  first  or  second  order  autoregressive  (AR)  process.  This  result 
suggests  an  asymptotic  approach  for  establishing  consistency  in  var¬ 
ious  wavelet-based  estimators  in  which  the  within  scale  correlations 
are  model  by  AR  processes  whose  orders  are  allowed  to  grow  as  the 
sample  size  becomes  infinite. 

3.  ‘Wavelet-Based  Trend  Detection  and  Estimation’,  R  F.  Craigmile  and 
D.  B.  Percival  (2002),  in  Encyclopedia  of  Environmetrics  (Volume  4), 
edited  by  A.  H.  El-Shaarawi  and  W.  W.  Piegorsch,  Chichester,  Eng¬ 
land:  John  Wiley  and  Sons,  pp.  2334-8.  This  peer-reviewed  contribu¬ 
tion  is  a  review  of  the  literature  on  wavelet-based  trend  detection  and 
estimation  and  summaries  some  of  the  work  in  two  of  our  papers  (see 
items  5  and  6  below). 

Here  is  a  listing  of  the  articles  supported  by  this  contract,  along  with  a 

synopsis  and  their  publication/submission  status. 

1.  ‘Inertial  Range  Determination  for  Aerothermal  Turbulence  using  Frac¬ 
tionally  Differenced  Processes  and  Wavelets’,  W.  Constantine,  D  .B. 
Percival  and  P.  G.  Reinhall  (2001),  Physical  Review  E,  64(3)  036301, 
12  pages.  A  fractionally  differenced  (FD)  process  is  used  to  model 
aerothermal  turbulence  data  and  the  model  parameters  are  estimated 
via  wavelet  techniques.  Theory  and  results  are  presented  for  three  es¬ 
timators  of  the  FD  parameter:  an  ‘instantaneous’  block  independent 
least  squares  estimator  and  block  dependent  weighted  least  squares 
and  maximum  likelihood  estimators.  Confidence  intervals  are  devel¬ 
oped  for  the  block  dependent  estimators.  We  show  that  for  a  majority 
of  the  aerothermal  turbulence  data  studied  herein,  there  is  a  strong  de¬ 
parture  from  the  theoretical  Kolmogorov  turbulence  over  finite  ranges 
of  scale.  A  time-scale  dependent  inertial  range  statistic  is  developed 
to  quantify  this  departure. 

2.  ‘Simulating  a  Class  of  Stationary  Gaussian  Processes  using  the  Davies- 
Harte  Algorithm,  with  Application  to  Long-Memory  Processes’,  P.  F. 
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Craigmile  (2002),  Journal  of  Time  Series  Analysis,  in  press.  This 
article  offers  a  proof  that  all  stationary  and  invertible  fractionally 
differenced  processes  have  a  circulant  embedding  and  hence  can  be 
simulated  efficiently  and  exactly  using  the  Davies-Harte  algorithm. 

3.  ‘Exact  Simulation  of  Time- Varying  Fractionally  Differenced  Processes,’ 
D.  B.  Percival  and  W.  L.  B.  Constantine  (2002),  Journal  of  Compu¬ 
tational  and  Graphical  Statistics,  under  review.  Time-varying  frac¬ 
tionally  differenced  (TVFD)  processes  can  serve  as  useful  models  for 
certain  time  series  whose  statistical  properties  evolve  over  time.  The 
spectral  density  function  for  a  TVFD  process  obeys  a  power  law  whose 
exponent  can  be  time  dependent.  In  contrast  to  locally  stationary 
or  locally  self-similar  processes,  the  power  law  exponent  for  a  TVFD 
process  is  not  restricted  to  certain  intervals,  which  is  of  practical  im¬ 
portance  for  modeling  time  series  of,  e.g.,  atmospheric  turbulence.  In 
this  paper  we  construct  a  uniform  representation  for  Gaussian  TVFD 
processes  that  allows  the  power  law  exponent  to  evolve  in  an  arbi¬ 
trary  manner.  Even  though  this  representation  in  general  involves  a 
time-dependent  linear  combination  of  an  infinite  number  of  random 
variables  from  a  white  noise  process,  we  demonstrate  that  simulations 
with  exactly  correct  statistical  properties  can  be  achieved  based  upon 
two  well-known  approaches,  each  of  which  involves  a  finite  number 
of  white  noise  deviates.  The  first  approach  is  based  on  a  modified 
Cholesky  decomposition,  and  the  second,  on  a  circulant  embedding. 
Use  of  these  exact  methods  will  ensure  that  Monte  Carlo  studies  of 
the  statistical  properties  of  estimators  for  TVFD  processes  are  not  ad¬ 
versely  influenced  by  imperfections  arising  from  the  use  of  approximate 
simulation  methods. 

4.  P.  F.  Craigmile  and  D.  B.  Percival  (2002),  ‘Asymptotic  Decorrela¬ 
tion  of  Between-Scale  Wavelet  Coefficients,’  to  be  submitted  to  IEEE 
Transactions  on  Information  Theory  by  the  end  of  October  2002. 
One  reason  that  the  discrete  wavelet  transform  (DWT)  is  useful  for 
analysing  time  series  is  that,  for  certain  series,  the  wavelet  coefficients 
produced  by  the  DWT  are  approximately  uncorrelated;  i.e.,  the  DWT 
reexpresses  the  random  variables  (RVs)  describing  a  correlated  time 
series  in  terms  of  approximately  uncorrelated  RVs,  which  are  much 
easier  to  deal  with  statistically  than  the  original  series.  This  decorre¬ 
lation  property  is  a  good  approximation  for  time  series  arising  from 
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processes  such  as  a  fractionally  differenced  (FD)  process,  fractional 
Gaussian  noise  and  fractional  Brownian  motion,  but  is  not  a  decent 
approximation  for  certain  autoregressive  ( AR)  and/ or  moving  average 
processes.  The  failure  of  the  decorrelation  property  in  these  latter 
cases  is  due  to  the  fact  that,  within  a  certain  scale,  the  wavelet  coeffi¬ 
cients  need  not  be  approximately  uncorrelated.  In  this  paper  we  prove 
that,  as  the  width  L  of  the  filter  used  to  form  the  DWT  increases, 
the  correlation  between  wavelet  coefficients  on  different  scales  neces¬ 
sarily  decreases  to  zero  for  a  very  general  class  of  stochastic  processes, 
namely,  Gaussian  processes  with  a  spectral  density  function  (SDF) 
that  can  be  expressed  as  the  product  of  the  SDF  for  an  FD  process 
and  any  bounded  SDF  (the  FD  process  need  not  be  stationary,  but  can 
be  nonstationary  with  stationary  backward  differences).  We  demon¬ 
state  that  this  asymptotic  result  is  a  decent  approximation  for  filter 
widths  used  in  practice  by  computing  the  maximum  absolute  between- 
scale  correlation  for  two  processes,  an  FD  process  whose  within-scale 
coefficients  are  approximately  uncorrelated,  and  an  AR  process  whose 
unit-scale  coefficients  exhibit  substantial  correlation.  Our  basic  result 
suggests  a  ‘two  part’  strategy  for  establishing  asymptotic  statistical 
results  based  upon  the  DWT.  The  first  part  is  to  let  the  filter  width 
L  increase  such  that  between-scale  coefficients  are  decorrelated  to  a 
certain  quantifiable  degree,  and  the  second  part  is  to  explicitly  model 
the  correlation  structure  of  the  coefficients  with  a  given  scale  (this 
strategy  is  used  in  the  next  two  papers). 

5.  P.  F.  Craigmile,  P.  Guttorp  and  D.  B.  Percival  (2002),  ‘Wavelet-Based 
Parameter  Estimation  for  Trend  Contaminated  Fractionally  Differ¬ 
enced  Processes,’  to  be  submitted  to  IEEE  Transactions  on  Signal 
Processing  in  the  Fall  of  2002.  One  interesting  aspect  of  DWTs  that  are 
based  upon  the  Daubechies  class  of  wavelet  filters  of  width  L  is  that, 
because  the  filter  can  be  expressed  as  the  convolution  of  a  smoothing 
filter  and  a  difference  filter  of  order  L/2,  the  nonboundary  DWT  coef¬ 
ficients  for  a  time  series  are  invariant  upon  addition  of  a  polynomial  of 
order  Lf  2  —  1.  In  this  paper  we  consider  time  series  that  can  be  mod¬ 
eled  as  the  sum  of  an  FD  process  and  a  polynomial  trend  and  establish 
a  large  sample  theory  for  the  estimation  of  the  FD  parameters  under 
the  assumption  of  (i)  a  white  noise  model  for  the  within-scale  wavelet 
coefficients  and  (ii)  a  first  order  AR  model  for  these  coefficients.  We 
demonstrate  that  both  large  sample  theories  are  decent  approxima- 
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tions  by  comparing  them  to  results  from  Monte  Carlo  experiments. 
We  compare  our  wavelet-based  estimator  for  the  FD  parameters  with 
one  proposed  recently  by  Hurvich  and  Chen  (2000)  and  find  that  our 
estimator  has  considerably  smaller  mean  square  error.  This  work  pro¬ 
vides  theoretical  justification  for  the  use  of  wavelet-based  estimators 
on  time  series  that  are  potentially  corrupted  by  a  trend  component  (as 
seems  to  be  the  case  with  certain  aerothermal  measurements). 

6.  P.  F.  Craigmile,  R  Guttorp  and  D.  B.  Percival  (2002),  ‘Trend  Assess¬ 
ment  in  a  Long  Memory  Dependence  Model  using  the  Discrete  Wavelet 
Transform,’  to  be  submitted  to  Journal  of  Environmetrics  upon  com¬ 
pletion.  In  this  companion  paper  to  the  previous  one,  we  consider 
the  properties  of  wavelet-based  estimators  of  the  trend  component  in 
a  time  series  consisting  of  the  sum  of  a  polynomial  trend  and  an  FD 
process.  The  basic  idea  is  that  the  DWT  isolates  the  trend  compo¬ 
nent  in  the  boundary  wavelet  coefficients  and  the  scaling  coefficients 
(as  discussed  in  the  companion  paper,  the  nonboundary  wavelet  coeffi¬ 
cients  can  be  used  to  estimate  the  FD  parameters) .  We  investigate  the 
statistical  properties  of  the  trend  estimate  and  establish  consistency 
of  the  estimate  under  certain  simple  conditions.  We  provide  pointwise 
and  simultaneous  confidence  intervals  for  the  trend  estimate.  We  also 
consider  a  test  for  nonzero  trend  that  is  based  upon  evaluating  the 
expected  power  in  the  boundary  wavelet  coefficients  and  the  scaling 
coefficients  under  the  null  hypothesis  of  no  trend.  Our  methodology 
can  be  used  to  test  for  the  presence  of  a  trend  component  in  time  series 
similar  to  aerothermal  measurements. 

The  software  manual  is 

•  S-hWavelets  2.0  Manual,  W.  Constantine  and  D.  B.  Percival  (2002), 
Insightful  Corporation. 

The  ‘beta’  version  of  this  manual  is  attached  at  the  end  this  final  report  as 
Appendix  A. 

Updated  information  regarding  these  publications  (along  with  other  in¬ 
formation  about  our  project)  is  maintained  at  a  Web  site  we  have  developed 
at  the  National  Simulation  Resource  Center,  Department  of  Bioengineering, 
University  of  Washington.  The  URL  for  this  site  is 

http://nsr.bioeng.washington.edu/STTR/AFSTTRHome.html 
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1.2  Invited  Talks 

We  were  invited  to  give  two  talks  based  upon  our  work  on  this  contract. 

1.  ‘The  Impact  of  Wavelet  Coefficient  Correlations  on  Fractionally  Differ¬ 
enced  Process  Estimation’,  P.  F.  Craigmile,  D.  B.  Percival  and  P.  Gut- 
torp,  presented  by  Craigmile  at  the  European  Congress  of  Mathemat¬ 
ics,  Barcelona,  Spain,  July  12,  2000  (Andrew  Walden,  organizer).  A 
written  version  of  this  talk  subsequently  appeared  in  a  book  (see  1.1 
above). 

2.  ‘Wavelet-Based  Maximum  Likelihood  Estimation  for  Trend  Contam¬ 
inated  Long  Memory  Processes,’  P.  F.  Craigmile  and  D.  B.  Percival, 
presented  by  Craigmile  in  a  session  on  ‘Recent  Developments  in  Time 
Series  Analysis’  at  the  23’’'^  European  Meeting  of  Statisticians,  Fun¬ 
chal,  Madeira,  Portugal,  August  16.  2001  (Jan  Beran,  organizer). 

1.3  Software 

As  an  important  part  of  our  contract  with  the  Air  Force  in  this  phase  II 
STTR,  the  techniques  (such  as  those  described  in  the  next  section)  were  im¬ 
plemented  into  a  commercial  grade  software  toolkit  in  the  S-PLUS,  Mat- 
LAB,  and  C  languages.  We  have  developed  a  state-of-the-art  software  mod¬ 
ule  S-t- Wavelets  written  almost  entirely  in  C  (for  speed  and  portability) 
with  wrapper  functions  to  S-PLUS  and  Matlab.  The  ‘beta’  version  of 
S-f  Wavelets  is  scheduled  for  release  in  October  2002.  After  obtaining 
feedback  from  our  software  testers,  we  will  release  and  support  a  fully  func¬ 
tional  commercial  version  of  S-|- WAVELETS. 

2  Accomplishments/New  Findings 

In  this  section  we  summarize  our  efforts  in  applying  novel  wavelet-based  frac¬ 
tionally  differenced  (FD)  model  parameter  estimation  techniques  to  aero- 
thermal  turbulence  data.  A  more  detailed  discussion  of  these  findings  may 
be  found  in  our  paper  [CPROl].  We  also  show  our  progress  in  forecast¬ 
ing  FD  parameters  using  turbulence  data  and  detail  the  progress  made  in 
developing  a  commercial  grade  software  toolkit  for  our  sponsor. 
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2.1  Wavelet-based  estimation  for  non- stationary  multi-scale 
fractal  processes 

Here  we  use  a  fractionally  differenced  (FD)  process  to  model  aerothermal 
turbulence  data  and  estimate  the  model  parameters  are  via  wavelet  tech¬ 
niques  developed  for  this  contract.  Theory  and  results  are  presented  for  three 
estimators  of  the  FD  parameter:  an  ‘instantaneous’  block  independent  least 
squares  estimator  and  block  dependent  weighted  least  squares  and  maxi¬ 
mum  likelihood  estimators.  Confidence  intervals  are  developed  for  the  block 
dependent  estimators.  We  show  that  for  a  majority  of  the  aerothermal  tur¬ 
bulence  data  studied  herein,  there  is  a  strong  departure  from  the  theoretical 
Kolmogorov  turbulence  over  finite  ranges  of  scale.  A  time-scale  dependent 
inertial  range  statistic  is  developed  to  quantify  this  departure. 

As  in  [KPC94,  PSW98],  we  used  wavelet  techniques  to  analyze  intermit¬ 
tent  deviations  from  Kolmogorov  inertial  subrange  behavior  for  measured 
temperature-based  turbulence  data.  We  extend  these  works  by  (1)  using 
higher  order  wavelet  filters  (non-Haar  wavelets)  to  avoid  spurious  estimates 
of  model  parameters,  (2)  refining  novel  block  estimation  techniques  with 
weighted  least  squares  and  maximum  likelihood  estimators,  (3)  develop¬ 
ing  an  instantaneous  (block  independent)  least  squares  estimator,  (4)  using 
simple  diagnostic  statistics  as  means  of  identifying  anomalous  determinis¬ 
tic  structure  imposed  by  the  measurement  system  (thereby  helping  us  to 
eliminate  scales  over  which  a  stochastic  fractal  model  is  inappropriate)  and 
(5)  developing  confidence  intervals  for  the  block  dependent  estimators. 


Fractionally  Differenced  Processes 

The  FD  process  was  originally  proposed  by  Granger  and  Joyeux  [GJ80]  and 
Hosking  [Hos81]  as  an  extension  to  an  autoregressive,  integrated,  moving 
average  model  in  which  the  order  of  integration  is  allowed  to  assume  nonin¬ 
teger  values. 


Definition  2.1  LetS  GR  and  >  0.  We  say  that  {Xt}tez  is  an  FD{6,ag) 
if  it  has  a  spectral  density  function  (SDF) 


Sxif)  = 


I2sin(7r/)p 


I/I  <  1/2, 


(1) 


where  cr^  is  the  innovation  variance,  and  S  is  the  fractionally  differenced 
parameter. 
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When  6  <  1/2,  an  FD  process  is  stationary;  when  -1/2  <  ^  <  1/2,  its 
autocovariance  sequence  (ACVS)  is  given  by 


CTg  sin(7r(5)r(l  —  25)r(T  +  S) 
7rr(r  +  1-5) 


(2) 


where  r(-)  is  Euler’s  gamma  function  [AS64].  When  <5  >  1/2,  we  obtain 
a  class  of  nonstationary  processes  that  are  stationary  if  {XJ  is  differenced 
d  =  +  1/2J  times,  where  differencing  by  d  means  to  form  the  process 

ELo  (e-g-,  we  get  Xt-Xt-i  when  d  =  1  and  Xt-2Xt-i+Xt-2 

when  d  =  2),  and  [xj  is  the  greatest  integer  less  than  or  equal  to  x.  By 
inspection  of  Eq.  (1),  an  FD(^,  cr|)  process  approximately  obeys  a  power  law 
process,  i.e.,  Sxif)  oc  |/|“,  at  low  frequencies  with  a  =  -2S  (the  error  in 
this  approximation  is  quite  small  for  |/|  <  1/8  —  the  range  of  frequencies 
that  we  are  interested  in  for  the  application  discussed  below  is  well  below 
1/8  in  standardized  units).  For  simplicity,  we  assume  that  E{Xt}  =  0 
throughout  (in  practice,  this  assumption  does  not  lose  us  any  generality 
in  what  we  discuss  below  because  of  the  differencing  operations  that  are 
embedded  in  wavelet  filters).  It  should  be  noted  that  an  FD  process  is 
formulated  in  discrete  time  (as  opposed  to  continuous  time)  so  that  the 
highest  observable  frequency  is  the  Nyquist  frequency  (1/2  in  standardized 
units).  Use  of  discrete  time  models  avoids  nonphysical  complications  that 
occur  with  continuous  time  power  law  models  that  have  infinite  variance 
due  to  an  insufficient  decay  of  the  SDF  as  /  — ^  oo  when  a  >  —  1. 

For  purposes  of  studying  turbulence  data,  an  FD  process  has  certain 
advantages  over  similar  models  such  as  fractional  Brownian  motion  (fBm) 
and  fractional  Gaussian  noise  (fGn). 


•  Unlimited  power  law  exponent  range.  Both  fBm  and  fGn  are 
stochastic  power  law  processes  in  that  their  SDFs  are  approximately 
proportional  to  |/1“  at  low  frequencies;  however,  an  fBm  is  limited 
to  an  exponent  range  of  —3  <  a  <  —  1  while  a  fGn  is  limited  to 
-1  <  a  <  1.  An  FD  process  is  also  a  stochastic  power  law  process, 
but  it  has  no  such  limitation  on  its  exponent  range  and  is  theoretically 
well-defined  for  a  €  R- 

•  Model  continuity.  Because  fBm  and  fGn  jointly  cover  power  laws 
ranging  from  — 3  up  to  1  (adequate  to  model  some  —  but  not  all  ~ 
turbulent  phenomena),  it  is  tempting  to  select  between  fBm  and  fGn 


8 


to  model  various  turbulent  series;  however,  neither  model  actually  in¬ 
cludes  the  case  a  =  —  1  (known  as  1//,  pink,  or  flicker  noise),  and  there 
is  a  discontinuity  between  the  fGn  and  fBm  models  close  to  a  =  —1  at 
high  frequencies,  which  can  lead  to  problems  in  model  selection.  Un¬ 
fortunately,  many  real  world  phenomena  exhibit  1/f  noise  [BLW94], 
An  FD  process  has  no  such  discontinuity.  In  addition,  an  FD  process 
is  closed  under  differencing  operations  with  regard  to  its  SDF;  i.e.,  an 
FD(5,af)  process  that  has  been  subjected  to  a  dth  order  differencing 
operation,  yields  an  FD(^  ~  process.  An  fGn  or  fBm  process 
subjected  to  the  same  differencing  operation  will  not  yield  the  same 
type  of  process,  which  is  another  indication  that  an  FD  process  is  a 
more  flexible  and  tractable  model. 

•  Tractable  SDF  and  AC  VS.  In  contrast  to  the  fBm  and  fGn  mod¬ 
els,  an  FD  process  has  tractable  forms  for  both  its  SDF  and  (when 
stationary)  corresponding  ACVS;  i.e.,  the  expressions  for  both  the 
SDF  and  ACVS  of  the  FD  model  can  be  readily  computed  without 
having  to  approximate  any  infinite  summations  (this  is  not  true  for 
fGn). 

•  Model  flexibility.  Both  autoregressive  and  moving  average  com¬ 
ponents  can  be  added  to  an  FD  process  to  provide  more  flexibility  in 
modeling  high  frequency  spectral  content,  leading  to  the  well-known 
class  of  autoregressive,  fractionally  integrated,  moving  average  mod¬ 
els  [Ber94].  The  high  frequency  content  of  measured  data  is  often 
contaminated  by  exogenous  noise  sources,  and  thus  flexible  modeling 
of  this  region  is  appropriate.  The  fBm  and  fGn  models  are  not  readily 
amenable  to  such  additions  as  they  would  further  complicate  the  SDF 
and  ACVS. 

Discrete  wavelet  transforms 

Consider  a  uniformly  sampled  time  series  with  N  divisible  by  2'^  for 

J  E  N.  For  L  an  even  positive  integer,  let  {hij}^SQ  be  a  Daubechies  [Dau92] 
wavelet  filter  with  squared  gain  function 

=  2siii^(7r/)  ^  ^  cos^^W).  (3) 

Equation  (3)  does  not  uniquely  define  a  wavelet  filter,  and  an  additional 
phase  criterion,  such  as  extremal  or  least  asymmetric  phase,  must  be  im- 
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posed  to  do  so  (use  of  the  latter  criterion  means  that,  after  an  appropriate 
shift  in  time,  the  wavelet  filter  has  approximately  zero  phase).  Let  {gi,i}f'SQ 
be  a  scaling  filter,  defined  by  the  quadrature  mirror  filter  relation 

gi,i  =  (4) 

The  squared  gain  function  for  a  Daubechies  scaling  filter  is  given  by 

^  2cos'-W)  ‘e'  WV/)-  (6) 

The  wavelet  and  scaling  filters  are  used  in  a  ‘pyramid’  algorithm  [Mal89] 
to  transform  into  a  collection  of  wavelet  coefficients  Wj^t  scaling 
coefficients  Vj^t  l^hat  can  be  associated  with  scales  of,  respectively,  rj  =  2^  ^ 
and  2rj,  j  =  1, . . .  ,  J  (these  standardized  scales  can  be  converted  to  phys¬ 
ical  scales  by  multiplying  them  by  the  sampling  time  between  contiguous 
observations  in  {Xt}).  Implementation  of  the  DWT  begins  by  defining  the 
zeroth  level  scaling  coefficients  to  be  the  original  time  series:  Vo,t  =  Xt.  The 
level  j  wavelet  coefficients  Wj^t  and  scaling  coefficients  Vj^t  are  then  formed 
recursively  by 


L-\ 

^  modiVj-i  5 

(6) 

L-1 

Vj.t  =  modiVj^i  ? 

(7) 

where  t  =  0,...  ,iVj  -  1  and  Nj  =  N/2^.  For  an  integer  J'  satisfying 
1  <  J'  <  J,  we  define  a  level  J'  DWT  of  {Xt}  to  be  the  collection  of  vectors 
Wi,  W2, . . .  ,  Wjf,  Vj/,  where  Wj  contains  the  Nj  wavelet  coefficients  Wj^u 
while  V J!  contains  the  Nji  scaling  coefficients  Vji^f 

The  pyramid  algorithm  represented  by  Eq.  (6)  can  also  be  interpreted 
3s  a  cascade  filter  bank  operation.  Thus  an  alternative  (but  less  efficient) 
method  for  computing  Wj^t  is  to  subsample  what  we  would  get  by  filtering 
Xt  with  a  single  filter,  say  that  is  the  equivalent  filter  for  the  cascade 
filter  bank.  This  filter  is  an  approximate  bandpass  filter  with  nominal  pass- 
band  /  e  [l/4Tj,  l/2rj].  The  corresponding  equivalent  scaling  filter  gj^i  used 
to  create  the  Vj^t  is  a  low  pass  filter  with  nominal  pass-band  /  G  [0,  l/4rj]. 
Figure  1  shows  the  squared  gain  responses  siiid  Gj,s{f)  for  hj^i  and 

j  =1  1,...  ,4,  corresponding  to  an  8-tap  Daubechies  wavelet  filter  hi^i 
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Figure  1:  The  squared  gain  functions  for  Daubechies  least  asymmetric  8-tap 
wavelet  filter  for  levels  j  =  1,...  ,4.  For  simplicity,  the  sampling  period 
was  set  to  unity  to  create  the  frequency  axis  and  establishes  the  Nyquist 
frequency  at  1/2.  The  dotted  vertical  lines  identify  the  frequency  bands 
with  which  the  wavelet  and  scaling  filters  are  associated.  The  scaling  of  the 
left  (right)  ordinate  is  representative  of  the  DWT  (MODWT)  squared  gain 
function. 
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and  illustrates  the  bandpass  and  lowpass  nature  of  the  equivalent  wavelet 
and  scaling  filters. 

When  considering  the  statistical  properties  of  DWT  coefficients,  it  is  use¬ 
ful  to  divide  the  wavelet  and  scaling  coefficients  into  boundary  and  interior 
coefficients.  Boundary  coefficients  are  those  subject  to  change  if  the  ‘mod’ 
operator  were  to  be  dropped  in  Eq.  (6).  These  boundary  coefficients  must 
be  ignored,  e.g.,  when  calculating  unbiased  wavelet  variance  estimates  (see 
Eq.  (15)  below).  The  number  of  boundary  coefficients  in  Wj  or  Vj  is  given 
by  where  L'  =  \{L  -  2)(1  -  2-^)1,  and  [re]  is  the  smallest 

integer  that  is  greater  than  or  equal  to  x  (for  large  j,  Lj  =  L  —  2).  The 
remaining  M,  =  Nj  -  imn{LpNj}  coefficients  make  up  the  set  of  interior 
coefficients.  The  boundary  coefficients  are  the  first  Nj  —  Mj  coefficients  in 
Wj  or  Vj,  while  the  interior  coefficients  are  the  last  Mj  elements  in  these 
vectors. 

A  physical  interpretation  of  the  DWT  based  upon  Daubechies’  class  of 
compactly  supported  wavelet  filters  is  that  the  Wy,t  measure  the  difference 
(centered  at  a  particular  time)  between  adjacent  weighted  averages  of  {Xt} 
at  scale  r,  .  Large  values  for  the  Wj^t  indicate  that  {Xt}  tends  to  have  large 
variations  over  time  scales  of  length  Tj.  Similar  to  the  wavelet  coefficients, 
the  scaling  coefficients  Vjj  are  weighted  averages  of  {Xt}  on  a  scale  of  2Tj. 

Despite  its  popularity,  the  DWT  has  two  practical  limitations.  The 
first  is  the  dyadic  length  requirement.  While  the  DWT  can  be  adapted  to 
accommodate  arbitrary  length  sequences  via,  e.g.,  polynomial  extensions  of 
the  scaling  coefficients,  selecting  an  appropriate  number  of  end  points  to 
fit  or  the  order  of  fit  is  not  a  trivial  task.  Other  techniques  can  be  used, 
but  generally  involve  either  complicated  bookkeeping  or  are  too  simple  to 
accurately  portray  the  dynamics  of  the  scaling  coefficients.  The  second 
limitation  is  a  sensitivity  of  the  DWT  to  where  we  start  recording  a  time 
series;  i.e.,  the  decimation  operation  makes  the  DWT  a  non  shift-invariant 
transform  so  that  circularly  shifting  the  time  series  can  alter  the  entire  DWT. 

To  overcome  these  limitations,  we  can  use  a  nondecimated  form  of  the 
DWT,  known  as  the  maximum  overlap  DWT  (MODWT),  that  has  two 
main  advantages:  (1)  it  handles  arbitrary  length  sequences  inherently  and 
(2)  circularly  shifting  the  time  series  will  result  in  an  equivalent  circular 
shift  of  the  MODWT  coefficients.  Additionally,  the  number  of  coefficients 
in  each  scale  is  equal  to  the  number  of  points  in  the  original  time  series.  This 
refined  slicing  of  the  data  in  combination  with  the  approximate  zero  phase 
property  of  the  least  asymmetric  filters  allows  us  to  calculate  ‘instantaneous’ 
statistical  measures  of  the  data  across  scales  (see  §2.1). 
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As  in  the  DWT,  implementation  of  the  MODWT  begins  by  defining 
the  zeroth  level  scaling  coefficients  to  be  the  original  time  series:  Vb,t  = 
Xf  Let  hi, I  =  /ii,j/y2  and ji,,  =  gi,ilyj2  for  /  =  0,...  ,L  -  1.  The 
MODWT  wavelet  coefficients  Wj^t  and  corresponding  scaling  coefficients  V^,t 
are  formed  recursively  by 

modN)  (^) 

L-1 

Vj^t  =  ^  modAT)  (9) 

1=0 

where  t  =  0, . . .  ,N  -1.  The  collection  of  vectors  Wi,  W2, . . .  ,  Wj,  Vj/  is 
the  level  J'  MODWT  of  {At},  where  Wj  contains  the  N  wavelet  coefficients 
Wj,u  while  V r  has  the  N  scaling  coefficients  Vji^f  The  number  of  boundary 
coefficients  in  Wj  or  Vj  is  Lj  =  min{(2-^  —  1)(L  —  1),  AT}. 

If  the  sample  size  AT  is  a  power  of  two,  the  MODWT  coefficients  and 
DWT  coefficients  are  related  by 

Wj,,  =  and  F,.,  =  ^^^,.,>(,+1,.,.  (10) 

The  DWT  can  thus  be  seen  as  a  scaled  and  subsamp^ed  version  of  the 
MODWT.  As  was  true  for  the  DWT,  we  could  obtain  Wj^t  by  filtering  Xt 
directly  with  an  equivalent  MODWT  wavelet  filter  hj^i.  This  filter  is  related 
to  the  corresponding  DWT  wavelet  filter  by  hj^i  =  and  a  similar 

result  holds  for  the  scaling  filters.  The  MODWT  squared  gain  functions  are 
thus  given  by  Hj^Lif)  =  and  (see  Fig.  1). 

Estimating  FD  parameters  with  wavelets 

Suppose  that  we  have  a  time  series  that  can  be  regarded  as  a  realization 
of  a  portion  X  =  [Xq,  Xi, . . .  ,  X^v-iF  of  FD(^,  a^)  process.  In  this  sec¬ 
tion  we  discuss  three  schemes  for  estimating  the  parameter  6  via  a  wavelet 
transform  of  X.  The  first  two  schemes  make  use  of  the  fact  that  the  re¬ 
lationship  between  the  variance  of  the  wavelet  coefficients  across  scales  is 
dictated  by  <5  in  such  a  manner  that  we  can  construct  a  least  squares  es¬ 
timator  (LSE)  of  6  (Abry  et  al  [AGF93,  AG95],  Abry  and  Veitch  [AV98] 
and  Jensen  [Jen99b]  consider  similar  estimators).  The  third  scheme  is  a 
wavelet-based  approximation  to  the  maximum  likelihood  estimator  (MLE) 
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of  ^  (Women  and  Oppenheim  [W092],  Wornell  [Wor93,  Wor96],  Kaplan  and 
Kuo  [Kap93],  McCoy  and  Walden  [MW96]  and  Jensen  [Jen99a,  JenOO]  dis¬ 
cuss  related  wavelet-based  MLEs).  The  first  LSE  and  the  MLE  make  use  of 
the  entire  time  series  and  hence  are  called  ‘block  dependent’  estimators;  by 
contrast,  the  second  LSE  utilizes  only  certain  coefficients  that  are  colocated 
in  time,  and  we  refer  to  it  as  an  ‘instantaneous’  estimator  (this  estimator 
would  not  change  if,  e.g.,  we  were  to  lengthen  the  time  series  by  prepending 
it  with  X_i). 

3.1.3(a)  Block  dependent  weighted  least  squares  estimator 


Let  Wj  be  the  MODWT  wavelet  coefficients  for  scale  r,-.  Here  we  develop 
a  weighted  LSE  (WLSE)  of  S  based  upon  an  estimator  of  the  variance  of 
the  interior  coefficients  in  Wj  over  a  range  of  scales  Tj  given  by  Jo  <  j  ^  Ji 
(the  selection  of  Jo  and  Ji  is  application  dependent  -  see  §2.3).  Under 
the  assumption  that  the  length  L  of  the  wavelet  filter  is  chosen  such  that 
L/2  >  L^  +  5J)  these  interior  coefficients  are  a  portion  of  a  stationary  process 
obtained  by  filtering  X  with  the  equivalent  MODWT  wavelet  filter 
Since  the  squared  gain  function  for  hj^i  is  given  by  'Hj,L{f)i  the  SDF  for  the 
interior  coefficients  is  given  by  'Hj,L{f)  Sx{f),  and  hence  their  variance  can 
be  expressed  as 

~  /•1/2  ~ 

^'x(Tj)  =  var{Wj,t}  =  j  Sxif)  df-  (H) 

Using  the  approximation  that  is  an  ideal  bandpass  filter  over  1/|  G 

[l/2•i+^  1/2^]  and  taking  into  consideration  the  even  symmetry  of  SDFs,  an 
approximation  to  the  wavelet  variance  is  given  by 

Sxif)  df.  (12) 

For  fractionally  differenced  processes,  we  have 


When  j  >  3,  so  that  smnf  w  tt/,  Eq.  (13)  can  be  approximated  by 

(U )  ~  ^  > 
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where  c((J)  =  -2^).  Equation  (14)  suggests  that  a  direct 

means  of  estimating  5  is  to  fit  a  least  squares  line  to  the  logarithm  of  an 
estimate  of  the  wavelet  variance,  say  I'xiTj)^  The  slope  of  the  line,  say  /3, 
that  best  fits  ln(z>^(rj))  versus  In(rj)  in  a  least  squares  sense  is  related  to  the 
FD  parameter  by  ^  =  (^+l)/2  and  the  power  law  exponent  by  a  =  —{(3+1). 

Given  a  time  series  of  length  iV,  we  can  obtain  an  unbiased  MODWT- 
based  estimate  of  the  wavelet  variance  by  defining 

where  Mj  =  N  -  Lj  +  1  is  the  number  of  MODWT  interior  wavelet  coeffi¬ 
cients.  As  a  caveat,  it  should  be  noted  that  the  wavelet  variance  estimates 
are  somewhat  sensitive  to  the  order  L  of  the  wavelet  filter  used  in  the  analy¬ 
sis.  In  particular,  studies  by  one  of  us  [PWOO]  have  shown  that  there  can  be 
a  significant  bias  in  estimating  6  (and  hence  a)  if  we  use  the  Haar  wavelet 
filter  (for  which  L -2).  This  bias  can  be  attributed  to  a  spectral  leakage 
phenomenon  and  can  be  attenuated  by  increasing  L.  In  practice  the  choice 
L  =  8  works  well,  so  we  have  used  it  in  all  analyses  presented  in  this  paper. 

The  distribution  for  i>x(rj)  is  approximately  that  of  a  random  variable 
given  by  where  x^j  is  a  chi-square  random  variable  with  rjj 

degrees  of  freedom  (§8.4  of  [PWOO]  discusses  toee  methods  for  determining 
T]j,  the  simplest  of  which  is  to  set  T]j  =  max{Mj/2^,  1}).  Define 

Y{Tj)  =  ln(i>^(Tj))  -■(/’(y) 

where  ^(•)  is  the  digamma  function.  The  properties  of  the  chi-square  dis¬ 
tribution  dictate  that 

var{y(rj)}  =  ‘ip'{r]j/2),  (17) 

where  V’'(  )  is  the  trigamma  function.  By  assuming  the  approximation  af¬ 
forded  by  Eq.  (14),  we  can  now  formulate  a  linear  regression  model  Y{Tj)  = 
7  +  j01n(Tj) -hej,  where  Cj  =  In  (i>^(Tj)/i/^(rj)) -V’(??i/2) +  ln  (77^/2)  defines 
a  sequence  of  errors,  each  with  zero  mean  and  variance  ^'{T]j/2).  If  we  take 
into  account  the  inhomogeneity  in  the  variance  in  these  errors,  we  arrive  at 
the  WLSE  of  the  slope  term  /3  given  by 


where  Wj  =  [ip'irij  /2)]~\  and  all  sums  are  over  j  =  Jo,  ,Ji-  The  weighted 
least  squares  estimate  of  the  FD  parameter  is  then 

^wlse  =  2^0wlse  +  !)• 

If  we  ignore  the  possible  correlation  between  the  error  terms  (which  we  can 
decrease  by  increasing  L),  the  variance  of  Pyjise  is  given  by 

r  A  -1  Z) 

var{/3.,„}  = 

(20) 


and  thus  the  variance  of  the  Sy^lse  is  given  by 


var{(Ju;/se}  =  ^vax{/3^/5e}- 


(21) 


Monte  Carlo  studies  indicate  that  Eq.  20  tends  to  overestimate  the  vari¬ 
ability  in  ^wise  somewhat  and  thus  can  be  regarded  as  a  conservative  upper 
bound  [PWOO]. 


3, 1.3(b)  Instantaneous  least  squares  estimator 

The  block  dependent  WLSE  we  formulated  above  depends  upon  the  en¬ 
tire  time  series  Tor  time  series  whose  statistical  properties 

are  evidently  evolving  over  time  (such  as  the  aerothermal  data  considered 
in  §2.3),  the  assumptions  behind  this  estimator  are  violated,  and  it  is  prob¬ 
lematic  to  use  this  estimator  on  the  entire  times  series.  If,  however,  we  can 
divide  the  time  series  up  into  blocks  within  which  we  can  assume  that  the 
data  are  the  realization  of  an  FD  process  (with  parameters  that  are  now 
allowed  to  vary  from  one  block  to  the  next),  we  can  apply  the  WLSE  esti¬ 
mator  on  a  block  by  block  basis.  In  practice,  each  of  the  blocks  will  contain 
the  same  number  of  points,  so  we  can  now  consider  N  to  be  the  size  of  each 
block  rather  than  the  length  of  the  entire  time  series.  The  choice  of  N  is 
usually  subjective  and  thus  open  to  question,  so  it  is  useful  to  have  some 
means  of  verifying  that  a  particular  choice  is  appropriate.  We  can  do  so 
by  formulating  an  ‘instantaneous’  estimator  that  is  independent  of  N  and 
that  can  be  used  to  check  for  departures  from  statistical  consistency  within 
a  proposed  block  size. 
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The  idea  behind  an  instantaneous  least  squares  estimate  of  ^is  to  use 
only  a  single  wavelet  coefficient  from  each  scale;  i.e.,  we  only  use  to  es¬ 
timate  where  tj  is  the  time  index  of  the  level  MODWT  coefficient 

associated  with  time  t  in  The  time  index  tj  can  be  meaningfully 

determined  only  if  (approximate)  linear  phase  wavelet  filters  are  used.  With 
this  substitution,  the  time  dependent  form  of  Eq.  (19)  becomes 

_  AjEln('rj)yt(Tj)-Slp('r?)Eyt(Tj) 
i>lse,t  2(AyEln'(Ti)-(Eln(r,-))2) 

(22) 


where  Aj  =  Ji  -  Jo  +  1  and  all  sums  are  over  j  =  Jo,--  -  ,Ji  and 

Yt{Tj)  =  HWlt.)  -  V>(l/2)  -  ln(2).  (23) 

To  decrease  the  variability  of  the  estimates  Aj  should  ideally  be  set  to  be 
as  large  as  is  feasible. 


3.1.3(c)  Block  dependent  maximum  likelihood  estimator 


Wavelet-based  maximum  likelihood  techniques  can  be  used  in  harmony 
with  an  FD  model  as  another  means  of  obtaining  estimates  for  FD  parame¬ 
ters.  Using  the  DWT  is  advantageous  in  that  it  is  known  to  decorrelate  long 
memory  FD  and  related  processes,  forming  a  near  independent  Gaussian 
sequence,  and  thus  simplifying  the  statistics  significantly  [CPGOOa].  The 
basic  idea  is  to  formulate  the  likelihood  function  for  the  FD  parameters  5 
and  erf  directly  in  terms  of  the  interior  DWT  wavelet  coefficients.  Let  W/ 
be  an  M  =  Ej  point  vector  containing  all  of  the  interior  DWT  wavelet 
coefficients  over  a  specified  range  of  scales  j  =  Jo,  -  -  ■  ,Ji-  We  can  write  the 
exact  likelihood  function  for  S  and  erf  as 

e-Wj’£w\W//2 

A<^,(^flW/)=  (27r)A^/2|Ew,P/^’ 


where  Ew/  is  the  covariance  matrix  of  W/,  and  |Sw/|  is  the  determinant 
of  Ew/-  Note  that  the  dependence  of  the  likelihood  function  on  5  and  erf  is 
through  Ew/  alone.  Under  the  assumption  that  the  wavelet  coefficients  in 
W /  are  approximately  uncorrelated,  Eq.  24  can  be  approximated  by 


J,  M,-l 

C{S,a]\Wi)=]l  n 


j=Jo  ^=0 


-VV"  ,  /(2C,  (<5,<r2)) 
:  ^  j 

(27rCj((J,af))V2 


(25) 
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where  Cj((S,  cr^)  is  an  approximation  to  the  variance  of  Wj^t  given  by  the 
average  value  of  the  SDF  in  Eq.  1  over  the  nominal  pass-band  [l/4rj,  l/2rj] 
for  the  equivalent  wavelet  filter  hj^i.  The  estimate  Smie  of  ^  is  obtained  by 
maximizing  C{S^ respect  to  S.  Equivalently  we  can  consider  the 
reduced  (natural)  log  likelihood  function 


Ji 

l{6\Wi)  =  Mln{a^,{6))  + 


j=Jo 


(26) 


where  CAS)  =  Cj{6,a'^)/c‘^e,  and 


Mj-1 

E 


(27) 


(see  [PWOO]  for  explicit  details  on  the  development  of  the  reduced  (natural) 
log  likelihood  function  using  the  DWT  coefficients).  Minimizing  Eq.  (26), 
which  is  a  function  of  S  alone,  yields  the  maximum  likelihood  estimate  Smie^ 
after  which  we  can  compute  the  corresponding  estimate  for  (t|  by  plugging 

^mle  into  Eq.  27.  ^ 

Under  the  assumption  that  6  G  [—1/2,  L/2],  the  estimator  6mie  for  large 
M  is  approximately  Gaussian  distributed  with  mean  S  and  variance 


r  *^1 


=  2 


E 

^j=Jo 


(28) 


where 


(i>j 


.,Jn(2sin(7r/)) 

ya.v{Wj,t}Jo 

2^+2  fi/2r,  In(2sin(7r/)) 

Cj (Smie)  J 1/4-0  [2  sin(7r/)]2^>nie 


df 


(29) 


(see  [CPGOOb]  for  details).  In  practice,  the  right-hand  integral  can  be  ap¬ 
proximated  through  either  (i)  numerical  integration  or  (ii)  a  Taylor  series 
expansion  about  the  mid- band  frequencies  for  levels  j  =  1,2  along  with 
direct  integration  using  a  small  angle  assumption  for  j  >  2.  The  approxi¬ 
mation  above  is  based  upon  the  view  that  the  wavelet  transform  forms  an 
octave  band  decomposition.  There  is  generally  a  large  increase  in  computa¬ 
tional  speed  when  using  this  bandpass  approximation  with  relatively  small 
loss  of  accuracy. 
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2.2  Wavelet-based  forecasting  for  non-stationary  multi-scale 
fractal  processes 

In  our  article  [CPROl],  we  used  a  fractionally  differenced  (FD)  process  to 
model  aerothermal  turbulence  data.  The  spectral  density  function  for  an 
FD  process  obeys  a  power  law  at  low  frequencies.  An  FD  process  has  two 
parameters,  one  of  which,  namely  can  be  related  to  the  power  law  ex¬ 
ponent  cx  simply  by  oc  =  — 25.  In  otur  work  we  used  wavelet  techniques  to 
estimate  S  and  hence  a.  In  addition  to  their  attractive  computational  prop¬ 
erties,  these  wavelet-based  estimators  are  statistically  tractable  and  allow 
us  to  study  time-evolving  FD  processes;  i.e.,  we  allow  a  to  vary  over  time. 
If  we  let  at  represent  our  estimate  of  a  at  time  t,  then  at  constitutes  a  time 
series  (specifically,  we  form  this  series  using  wavelet-based  block  dependent 
weighted  least  squares  estimates  for  a  7.5  million  point  aerothermal  turbu¬ 
lence  series  over  scales  spanning  0.59-2.35  meters  in  length;  see  [CPROl] 
for  details).  In  this  progress  report,  we  summarize  our  studies  to  date  on 
modeling  at  for  the  purpose  of  obtaining  forecasts  of  its  future  values  (if 
we  could  accurately  forecast  at,  we  would  be  able  to  forecast  some  salient 
properties  of  upcoming  atmospheric  turbulence).  Specifically,  we  use  five 
stochcLStic  models  to  predict  at.  Four  of  the  five  models  are  special  cases 
of  fractional  autoregressive,  integrated,  moving  average  (FARIMA)  models 
(these  are  also  called  ARFIMA  models).  These  are  first  and  fourth  order 
autoregressive  (AR)  models,  an  integrated  moving  average  (IMA)  model 
and  an  FD  model.  The  fifth  model  is  a  semiparametric  fractional  autore¬ 
gressive  (SEMIFAR)  model  [Ber],  which  is  an  extension  of  a  subclass  of 
FARIMA  models  that  allows  for  the  possibility  of  a  nonpolynomial  deter¬ 
ministic  trend.  In  what  follows,  we  describe  each  of  the  models  briefly  (§2.2) 
and  then  summarize  how  well  we  can  predict  the  at  series  using  each  model 
(§2.2). 

Stochastic  modeling  and  prediction 

As  noted  above,  four  of  the  five  models  that  we  consider  for  at  are  special 
cases  of  a  FARIMA  model.  We  can  define  this  model  in  terms  of  manipu¬ 
lations  yielding  a  process  that  can  be  directly  related  to  a  Gaussian  white 
noise  process  et  with  mean  zero  and  variance  a^.  To  do  so,  let  B  denote 
the  backward  shift  operator  so  that  Bat  =  (more  generally,  we  have 
B^at  =  at-j).  Let  $p(B)  =  1  -  be  a  pth  order  polynomial  in 

B  so  that,  for  example,  ^2{B)at  =  a^  —  (piat-i  —  (j>2^t-2  (for  completeness, 
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we  define  $o(5)  =  1)-  This  polynomial  captures  the  autoregressive  (AR) 
portion  of  the  model.  Similarly  let  0,(B)  =  1  -  Ej=i  technical 

reasons,  we  constrain  the  coefficients  (pj  and  6j  so  that  the  roots  of  the 
resulting  polynomials  ^p{B)  and  @q{B)  are  all  greater  than  unity  in  mag¬ 
nitude).  The  polynomial  Qq{B)  captures  the  moving  average  (MA)  portion 
of  the  model.  Let  d  be  a  nonnegative  integer  so  that  (1  —  B^at  represents 
the  dth  order  backward  difference  of  oct  (thus,  (1  —  B)(xt  =  aj  —  0:4-1 
(1  -  B)'^at  =  il-2B  +  B^)at  =  02-  2at-\  +  at-2  are  the  first  and  second 
order  backward  differences).  For  65  e  (-1/2, 1/2),  we  define  a  fractional 
difference  operator  via 


r{6s  + 1) 


{-lyBK 


(30) 


With  the  above  definitions,  we  say  that  at  is  a  FARIMA  process  if  we  can 
write 


$p(B)(l  -  By^{{l  -  B^at  -  /i}  =  Qq{B)et,  (31) 

where  /i  is  a  real-valued  constant.  Thus,  if  we  take  the  dth  order  backward 
difference  of  at  and  subtract  p  from  it,  then  the  resulting  process,  say  Pt  = 
(1  —  By  at  —  p,  can  be  expressed  as 

pt  =  ^-\B)il-Br^^eq{B)eu 

i.e.,  a  (possibly  infinite)  linear  combination  of  Gaussian  white  noise. 

AR(1) 

•  Mathematical  model: 

^i{B){at  -  fj)  =  St,  i.e.,  at  =  n  + (piiat-i  -  ^J>)  (32) 

•  Description:  An  AR(1)  model  is  a  special  case  of  a  FARIMA  process 
in  which  p  =  1,  <5s  =  0,  d  =  0  and  g  =  0.  An  AR(1)  model  is 
widely  used  in  the  physical  sciences  as  a  convenient  simple  model  for 
a  correlated  time  series.  The  estimated  parameters  for  this  model  are 
<^i  =  0.88  and  =  0.089  (p  is  estimated  using  the  sample  mean  a  of 
the  at  values). 
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AR(4) 

•  Mathematical  model: 

4 

$4(5)  (at  -  n)  =  eu  i-e.,  at-  n  +  ^  “  m)  (33) 

i=i 

•  Description:  Like  the  AR(1)  model,  an  AR(4)  model  is  a  special 
case  of  a  FARIMA  process,  but  now  we  set  p  =  4.  This  value  of  p  was 
determined  by  using  the  AIC  order  selection  criterion  to  select  a  best 
model  from  the  class  of  AR(p)  models.  The  estimated  parameters  are 
<l>i  =  0.55,  (f>i  =  0.13,  <f>i  =  0.05,  (f)i  =  0.23  and  d?  =  0.075  (again,  p 
is  estimated  using  a). 

IMA(1,3) 

•  Mathematical  model: 

3 

(1  —  B)at  =  03(jB)et,  i.e.,  at  =  at-i  + 

3=1  (34) 

•  Description:  An  IMA(1,3)  model  is  a  special  case  of  a  FARIMA 

process  in  which  p  =  0,  =  0)  ^  ~  f  g  =  3  (the  parameter 

jjL  actually  drops  out).  Use  of  a  FARIMA  model  with  d  —  0  was 
suggested  by  the  fact  that  one  of  the  roots  of  $4(5)  for  the  AR(4) 
model  above  was  fairly  close  to  the  unit  circle,  which  is  one  indication 
that  taking  the  first  difference  of  at  might  be  useful.  With  d  =  1  and 
Ss  =  0,  an  examination  of  different  low  order  choices  for  p  and  q  led 
to  the  IMA(1,3)  model.  The  estimated  parameters  are  61  =  0.4976, 
01  =  0.1373,  01  =  0.0879  and  =  0.074.  The  residuals  from  this 
fitted  model  are  very  close  to  white  noise. 

FD((5s) 

•  Mathematical  model: 

°°  f —6  \ 

(1  -  BY‘{at  -  p}  =  £t  j-e.,  at  =  p  +  5Z  / 

j=o  \  J  /  (35) 
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•  Description:  A  stationary  FD(^s)  process  is  a  special  case  of  a 
FARIMA  process  in  which  p  =  0,  d  =  0  and  g  =  0  (letting  d  be  a 
positive  integer  leads  to  the  nonstationary  FD  processes).  The  maxi¬ 
mum  likelihood  estimates  of  the  FD  parameters  are  =  0.4948,  which 
is  quite  close  to  the  nonstationary  boundary  (0.5).  This  model  ex¬ 
hibits  an  approximate  power  law  behavior  in  its  SDF  over  normalized 
frequencies  /  €  (0,1/8],  with  an  exponent  given  by  -0.9896.  An  al¬ 
ternative  way  of  estimating  6s  is  to  regress  the  log  periodogram  versus 
log  frequency  for  frequencies  0  <  /  <1/8.  This  yields  an  estimate  of 
Ss  =  0.4847,  which  is  quite  close  to  the  maximum  likelihood  estimate. 

SEMIFAR(p,(5s,d) 

•  Mathematical  model: 

$p(B)(l  -  bY^{{1  -  B^at  -  Tt]  =  et,  (36) 

where  Tt  is  assumed  to  be  a  smooth  function  representing  a  determin- 
istic  trend  in  the  dth  difference  of  at. 

•  Description:  A  SEMIFAR(p,  process  cannot  be  expressed  as 
a  FARIMA  process  and  is  not  a  generalization  of  this  process  because 
it  does  not  allow  for  a  moving  average  component.  With  q  =  0,  we 
obtain  a  SEMIFAR  process  from  a  FARIMA  process  by  substituting 
the  trend  component  Tt  for  /u.  With  d  taken  to  be  zero,  we  fit  this 
model  using  a  two  step  procedure.  In  the  first  step  we  estimate  Tt  by 
locally  fitting  weighted  low  order  polynomials  (lowess)  with  a  band¬ 
width  of  110  points,  from  which  we  can  form  a  set  of  residuals.  The 
use  of  lowess  here  differs  from  the  conventional  kernel  smoother  used 
by  Reran  [Ber],  but  it  yields  a  much  smoother  trend.  The  resulting 
trend  function  is  well  modeled  locally  by  a  quadratic  function;  i.e., 
(1  -  B)‘^Tt  ^  0,  In  the  second  step  we  considered  both  AR(p)  and 
FD{5s)  processes  as  models  for  the  residuals.  We  chose  an  FD  process 
here  and  obtained  the  maximum  likelihood  estimate  =  0.448  (this 
compared  well  with  a  periodogram-based  estimate  of  (Js  =  0.449). 

Prediction  Results 

The  results  presented  in  this  section  represent  a  manual  optimization  over 

model  parameters  based  on  a  minimization  of  the  mean  squared  prediction 
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Table  1:  Prediction  errors  of  the  block-based  at  series. 


method 

MSPE 

average  width 
of  error  bars 

^  points  outside 
error  bars 

AR(1) 

0.1788 

2.4765 

0 

AR(4) 

0.1668 

2.0942 

0 

IMA(1,3) 

0.3024 

1.8896 

3 

FD((5s) 

0.2238 

1.3918 

9 

SEMIFAR(0,<Js,  0) 

0.1700 

1.2691 

6 

error  (MSPE)  defined  by 

MSPE  =  ~  ^  (37) 

Et(«t  -  «) 

where  at  and  at  are  the  predicted  and  true  values,  respectively,  and  a  is 
the  sample  mean  of  a^.  In  each  case,  the  first  700  points  of  the  at  series 
were  used  to  obtain  the  model  parameters.  The  optimized  model  was  then 
used  in  a  recursive  single  step  prediction  routine  to  predict  the  remaining 
50  points  of  the  at  series. 

Table  1  and  Fig.  2  summarize  the  prediction  results.  The  AR(4)  model 
had  the  lowest  MSPE,  but  the  SEMIFAR  and  AR(1)  models  gave  competi¬ 
tive  results  (less  than  a  10%  increase  in  MSPE).  While  the  average  width  of 
the  error  bars  was  smaller  for  the  SEMIFAR  model  than  any  other  model, 
it  also  had  more  points  outside  the  error  bars  than  either  of  the  autoregres¬ 
sive  models.  Overall  the  results  are  encouraging  and  suggest  that  we  can 
make  fairly  accurate  short-term  prediction  of  the  time-varying  power  law 
exponent  a^. 

2.3  Analysis  of  measured  aerothermal  turbulence  data 

Using  the  techniques  described  in  §3.1,  we  estimated  the  FD  parameter  (5) 
using  turbulence-related  data  supplied  to  us  by  our  Air  Force  sponsor.  In 
this  section,  we  discuss  our  results  of  this  application.  For  a  more  detailed 
discussion  see  [CPROl]. 
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(a)  Alpha  series 


(b)  AR(1)  prediction 


Figure  2:  (a)  Block  dependent  weighted  least  squares  estimations  (WLSE)  of 
Qf  over  scales  Tg-rs  for  a  temperature  related  7.5  million  point  aerothermal 
turbulence  series  (see  [CPROl]  for  details).  The  dots  represent  the  WLSE 
while  the  line  is  a  lowess  smooth  trend.  A  50-step  ahead  prediction  was 
forecast  using  the  first  700  points  of  this  at  series  using  (b)  an  AR(1)  model, 
(c)  an  AR(4)  model,  (d)  an  IMA(1,3)  model  and  (e)  FDP((5s)  model,  (f) 
Prediction  using  the  SEMIFAR  models  (1  —  BY^{at  —  Tj)  =  £t,  where  6s  = 
0.448  and  Tt  is  the  trend  estimated  through  some  nonparametric  smoothing 
technique  (here  we  use  the  lowess  smoother  as  shown  in  (a))  .  In  each  case, 
the  at  series  is  denoted  by  the  dotted  solid  line  while  the  letter  ‘p’  denotes 
the  predicted  value  with  95%  confidence  intervals  spanned  by  the  ‘c’  letters. 
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Description  of  the  data 

Here  we  examine  a  uniformly  sampled  7.5  million  point  aerothermal  turbu¬ 
lence  data  set  (referred  to  as  ‘aero’  henceforth).  These  data  are  a  temperature 
related  time  series  gathered  by  an  aircraft  flying  at  a  constant  (or  linearly 
increasing)  elevation  and  constant  speed  in  clear  air  conditions.  The  mea¬ 
surement  system  is  a  cold- wire  probe,  externally  attached  to  the  aircraft, 
that  senses  fluctuations  in  local  temperature  by  means  of  a  proportional 
change  in  wire  current.  The  data  span  a  total  distance  of  137.3  km  with 
a  spatial  resolution  of  approximately  1.83  cm.  Due  to  the  large  amount  of 
data  in  the  aero  series,  we  will  use  MA(g,r)  filters  (moving  average  using 
windows  of  length  q  with  an  overlap  of  r  points)  for  purposes  of  display 
and  comparison  of  results.  Figure  3  shows  the  aero  series  smoothed  with 
a  MA(10000,0)  filter.  Typical  of  turbulence  data,  the  aero  series  exhibits 
seemingly  random  fluctuations  at  various  scales  and  times.  This  particular 
set  of  data  seems  to  have  a  change  in  some  of  its  characteristics  after  about 
80  km. 


Time  (min) 

4.55 _ 6  06 


Space  (km) 

Figure  3:  The  aero  series  smoothed  with  a  MA(10000, 0)  filter. 


FD  model  validation 

Figure  4  shows  a  DWT  transform  of  a  small  segment  of  the  aero  series  using 
Daubechies  8-tap  least  asymmetric  filters,  while  Fig.  5  shows  the  correspond- 
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ing  MODWT.  The  relationship  between  the  DWT  and  MODWT  given  in 
Eq.  (10)  can  be  visualized,  for  example,  by  comparing  the  DWT  scalmg 
coefficients  Ve.t  in  Fig.  4  with  the  corresponding  MODWT  coefficients  Fe.t 
in  Fig.  5. 
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Figure  4:  DWT  of  aerothermal  data  segment  using  Daubechies  8-tap  least 
asymmetric  filters.  The  number  in  the  curly  brackets  next  to  each  subband 
represents  the  amount  of  circular  shift  imposed  to  adjust  the  coefficients  to 
approximate  zero  phase.  A  negative  shift  value  implies  an  advance,  or  left 
circular  shift,  of  the  coefficients. 

Let  us  now  consider  modeling  the  aero  series  as  the  realization  of  an 
FD  process.  We  begin  by  considering  some  diagnostic  statistics  designed 
to  help  us  ascertain  if  in  fact  an  FD  model  is  appropriate.  If  this  series 
were  an  actual  realization  from  an  FD  process,  then,  to  a  good  approxima¬ 
tion,  the  interior  coefficients  in  should  be  a  realization  of  a  white  noise 
process  [PWOO,  CPGOOa].  To  see  if  this  is  true,  let  us  look  at  the  sample 
autocorrelation  functions  (ACFs)  for  Wj,  j  =  1,...  ,11,  of  a  representa¬ 
tive  sample  of  the  aero  data  along  with  the  ACF  of  the  data  itself  (Fig.  6). 
Under  the  white  noise  hypothesis,  standard  statistical  theory  suggests  that 
roughly  95%  of  the  sample  ACF  values  for  the  wavelet  coefficients  at  scale 
Tj  should  fall  between  ±  2y/Nj  -  n/Nj,  where  n  is  the  ACF  lag,  restricted 
here  to  range  from  0  to  128  [Ful96].  The  actual  percentage  of  coefficients 
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Figure  5:  MODWT  of  aerothermal  data  segment  using  Daubechies  8-tap 
least  asymmetric  filters. 


that  fall  within  these  limits  is  shown  to  the  right  of  each  plot.  The  ACF 
of  the  aero  segment  itself  shows  a  persistent  positive  correlation  typical  of 
an  FD  process;  however,  the  ACFs  for  Wi, . . .  ,  W5  exhibit  correlation  well 
outside  the  white  noise  limits,  evidently  due  to  energetic  deterministic  pat¬ 
terns.  This  is  particularly  apparent  in  the  ACFs  for  W4  and  W5,  which 
exhibit  a  strong  (SNR  >  0.5)  sinusoidal  beating  pattern  and  pure  sine  wave 
pattern,  respectively.  These  periodicities  are  suspected  to  be  due  to  an 
exogenous  factor  unrelated  to  aerothermal  turbulence  such  as  a  periodic  au¬ 
topilot  correction  or  harmonic  resonance  of  the  probe  armature,  inducing  a 
local  vibration  (and  corresponding  recorded  temperature  fluctuation)  in  the 
cold  wire  probe  instrumentation.  As  a  result,  these  deterministic  compo¬ 
nents  render  an  FD  model  inappropriate  over  those  scales.  For  scales  tq  and 
T7,  the  percentages  of  sample  ACF  values  falling  within  the  limits  are  still 
half  to  two  thirds  of  the  nominal  value  of  95%,  but  the  values  are  nonetheless 
quite  small  in  magnitude  (<  0.08  for  re  and  <  0.14  for  ry);  for  scales  rg  and 
above,  the  percentages  are  fairly  close  to  95%.  Thus,  in  keeping  with  an  FD 
model,  the  DWT  effectively  decorrelates  the  aero  segment  over  scales  tq  and 
higher,  so  this  ACF-based  diagnostic  suggests  just  applying  the  FD  model 
over  these  scales. 
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Figure  6:  Biased  autocorrelation  functions  of  a  2^^  point  segment  of  the 
aero  series  and  of  DWT  coefficients  for  Wi, . . .  ,  Wu. 

Let  us  now  look  at  a  second  diagnostic  statistic,  but  based  upon  the 
interior  MODWT  coefficients  in  Wj.  Figure  7  shows  an  example  of  unbiased 
wavelet  variance  estimates  for  one  2^^  point  block  in  the  aero  series.  As  can 
be  deduced  from  Eq.  (14),  a  multiscale  linear  pattern  in  a  In—ln  plot  of  the 
wavelet  variance  versus  Tj  would  be  consistent  with  the  presence  of  an  FD 
process;  however,  this  figure  shows  that  such  linear  patterns  appear  only 
over  a  quite  limited  range  of  scales.  If  we  segment  the  In  scaled  wavelet 
variance  curve  into  regions  over  which  a  linear  relationship  appears  to  hold, 
we  obtain  a  different  FD  parameter  5  over  scales  n  r4,  rs  - rr  and  rs  - ni. 
These  patterns  change  with  different  blocks,  indicating  both  time  varying 
and  scale  dependent  power  law  behavior. 

Using  the  collection  of  diagnostics  shown  in  Fig.  6-7,  we  can  demonstrate 
the  methodology  described  in  this  report  by  fitting  separate  FD  models  to 
the  aero  series  over  two  finite  ranges  of  scales,  namely,  —  rg  and  rg  —  th, 
each  spanning  approximately  three  octaves  of  frequencies  (to  simplify  our 
discussion  and  accompanying  figures,  we  do  not  consider  triads  of  higher 
scales). 
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Figure  7:  The  unbiased  MODWT  wavelet  variance  i>\  (rj)  of  a  representative 
portion  of  aero  using  Daubechies  least  asymmetric  8- tap  wavelet  filters.  The 
confidence  intervals  are  based  on  a  chi-square  distribution  assumption  where 
the  degrees  of  freedom  are  calculated  (1)  using  a  large  sample  approximation 
to  the  mean  and  variance  of  scales  ri, . . .  ,T5  and  (2)  under  an 

assumption  that  the  SDF  is  flat  over  the  nominal  passbands  in  which  the 
wavelet  coefficients  are  associated  for  re,...  ,tii.  See  [PWOO]  for  details  of 
wavelet  variance  confidence  intervals  and  their  development. 
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Block  dependent  WLSE 

Using  Eq.  (19)  and  the  relation  a  =  -26,  the  6iy,ise  were  calculated  for  the 
aero  series  over  scales  tq  —  ts  and  rg  —  t\\  (Fig.  8).  For  simplicity,  we  define 
the  term  to  mean  the  WLSE  of  the  power  law  exponent  over  scales 

Tjo,  •  •  •  The  and  d^/i\®  were  estimated  over  contiguous  nonover¬ 
lapping  blocks  of  size  10000  arid  20000,  respectively.  Due  to  the  sampling 
variability  present  in  the  wavelet  variance  estimates,  we  smoothed  all 
with  a  MA(20, 19)  filter  (the  choice  of  this  particular  filter  is  somewhat  arbi¬ 
trary,  but  such  smoothing  is  helpful  in  making  it  easier  to  see  how  a  evolves 
in  time  over  the  two  groupings  of  scales).  Note  the  apparent  wide  range 
of  dg;^®®  and  which  roughly  span  values  appropriate  for  stationary 

white  noise  up  to  nonstationary  random  walk  noise.  This  clearly  suggests 
that  a  single  (Kolmogorov)  exponent  is  not  an  adequate  description  of  this 
aerothermal  turbulence  data  as  might  be  incorrectly  construed  from  conven¬ 
tional  Fourier-based  methods  (see  §2.3).  To  quantify  this  effect  we  define 
the  inertial  range  percentage  as 

^  t^(var{djo,j,,p}^/^  -  |djo,7i,p  +  5/3|),  (38) 

p=i 

where  [/(•)  is  the  unit  step  function  and  OiJo,Ji,p  is  the  djo^jj  at  block  p  in 
time.  The  represents  the  percentage  of  unsmoothed  that  falls 

within  ±  var^dj^'^jj}^/^  of  the  Kolmogorov  exponent  (a  =  -5/3).  Using 
Eq.  38,  the  inertial  range  percentages  for  the  WLSE  curves  were  found  to 
be  7^1''®  =  8%  and  7^{f  =  45%.  Most  of  the  inertial  range  percentage  is 
achieved  where  there  is  a  moderate  coupling  of  d^3®®  and  d^j*®  over  (ap¬ 
proximately)  20-80  km. 

Block  independent  (instantaneous)  LSE 

Instantaneous  LSEs  of  oc  over  scales  t^  —  ts  were  calculated  for  the  entire  7.5 
million  point  aero  series  using  Eq.  22.  Figure  9  shows  the  dg  g’  smoothed 
with  a  MA(10000,0)  filter.  These  estimates  follow  the  same  pattern  exhib¬ 
ited  by  the  d^/g^®  shown  in  Fig.  8  but  with  a  bit  more  variability.  These 
variabilities  are  not  captured  by  the  block  dependent  estimators  and  illus¬ 
trate  the  importance  of  using  time  dependent  estimators  for  a  more  accurate 
portrayal  of  the  (turbulence)  dynamics. 
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Time  (min) 


Figure  8;  The  and  d^/if  of  the  aero  series  smoothed  with  a  MA(20, 19) 
filter.  The  confidence  limit’s  are  for  the  smoothed  estimates  shown  and  are 
constant  since  the  number  of  scales  over  which  the  estimates  are  made  is 
constant. 
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Figure  9;  Unbiased  d/^e.t  for  the  aero  series.  As  a  means  of  comparison  with 
Fig.  8,  a  MA(10000,0)  filter  was  used  to  smooth  the  results. 
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Block  dependent  MLE 

Figure  10  shows  the  maximuin  likelihood  estimates  of  o  for  the  aero  series 
smoothed  with  a  MA(20, 19)  filter.  These  estimates  are  noticeably  more 
coupled  in  the  spatial  range  of  20-80  km  than  are  the  &wise  shown  in  Fig.  8. 
Outside  of  this  spatial  range,  however,  both  the  and  the  show 

a  strong  departure  from  Kolmogorov  turbulence.  This  change  in  process 
dynamics  is  somewhat  discernible  in  the  smoothed  plot  of  the  aero  series 
(Fig.  3).  The  resulting  inertial  range  percentages  for  the  dm/e  s-re  = 
9%  («  and  =  22%  (« 


Time  (min) 


Figure  10:  The  and  of  the  aero  series  smoothed  with  a  MA(20, 19) 
filter. 


Comparison  to  Fourier  techniques 

Finally,  for  contrast,  let  us  look  at  a  common  way  to  analyze  turbulence 
data  through  an  estimate  of  its  SDF.  Conventionally,  power  law  exponents 
are  estimated  directly  from  an  estimate  of  the  SDF  for  the  data.  For  ex¬ 
ample,  the  slope  of  the  SDF  on  a  log-log  scale  provides  a  direct  estimate  of 
a.  Figure  11  shows  the  SDF  of  the  entire  aero  series,  computed  by  parti¬ 
tioning  the  aero  series  into  2^^®  point  blocks,  forming  a  spectral  estimate  for 
each  block  and  then  averaging  the  spectral  estimates  together.  The  average 
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SDF  portrays  a  strong  Kolmogorov  turbulence  slope  of  a  ~  5/3  over  many 

octaves.  This  global  approach  masks  the  fact  that  there  are  significant  de¬ 
viations  from  the  -—5/3  law  locally  in  time  and  hence  does  not  accurately 
portray  the  dynamics  of  a.  We  could,  of  course,  track  the  power  law  esti¬ 
mate  of  each  block  as  time  unfolds,  but  we  would  then  need  some  scheme  for 
partitioning  the  frequencies  into  regions  over  which  a  single  power  law  is  ap¬ 
plicable.  If  we  use  a  partitioning  scheme  that  is  essentially  the  same  as  what 
our  wavelet  methodology  yields,  the  work  of  McCoy  et  aL  [MW96]  shows 
that  wavelet-based  estimates  of  a  have  better  mean  square  error  properties 
than  do  those  based  upon  the  SDF. 


Vi 
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Figure  11:  Averaged  estimated  SDF  for  aero  series  and  the  theoretical  SDFs 
for  an  FD  process  and  pure  power  law  (PPL)  model  of  fully  developed 
Kolmogorov  turbulence  with  an  infinite  inertial  range.  The  FDP  and  PPL 
curves  are  purposefully  offset  from  the  average  SDF  of  aero  series  so  that  their 
In-ln  SDF  slopes  may  be  easily  compared  over  a  broad  range  of  scale.  The 
vertical  divisions  represent  the  octaves  over  which  the  wavelet  coefficients 
at  scale  Tj  are  nominally  associated. 


Discussion  of  results  for  FD  parameter  estimators 

In  this  progress  report  we  have  introduced  three  wavelet-based  techniques 
to  estimate  FD  model  parameters  for  aerothermal  turbulence  data:  block 
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independent  (instantaneous)  LSE,  and  block  dependent  WLSE  and  MLE. 
The  block  dependent  WLSE  and  MLE  verify  the  presence  of  time  varying 
power  law  processes  with  an  estimated  power  law  exponent  spanning  from 
white  noise  to  nonstationary  red  noise  and  applicable  over  finite  ranges  of 
scale.  Additionally,  averaged  block  independent  LSEs  were  shown  to  match 
well  with  block  dependent  WLSEs.  The  LSEs  are  an  effective  means  of 
obtaining  instantaneous  estimates  of  FD  parameters  (or,  through  the  ap¬ 
proximation  a  =  “2(5,  the  power  law  exponents)  and  are  consequently  very 
useful  in  detecting  changes  in  a  system  whose  dynamics  fluctuate  rapidly  as 
a  function  of  time  or  scale.  For  the  block  dependent  WLSE,  we  introduced 
methods  for  calculating  the  variance  of  FD  parameter  estimates  and  corre¬ 
sponding  confidence  intervals.  For  a  specified  range  of  the  FD  parameter  S 
and  under  a  large  sample  assumption,  we  showed  that  the  the  block  depen¬ 
dent  MLE  estimator  Smie  is  approximately  Gaussian  distributed  with  mean 
S,  and  we  developed  the  variance  of  the  estimator  ((t|  ^  ),  To  summarize 
the  departure  of  the  estimates  from  (fully  developed)  Kolmogorov  turbu¬ 
lence,  we  introduced  the  inertial  range  percentage  statistic,  which  quantifies 
the  time  and  scale  dependent  intermittency  of  Kolmogorov  turbulence.  The 
collection  of  results  supports  the  efficacy  of  using  stochastic  FD  models  for 
aerothermal  turbulence  data. 

2.4  Personnel  Supported 

The  key  personnel,  their  affiliation,  and  role  on  this  project  is  given  shown 
in  Table  1. 


Table  1:  Personnel  Supported  by  this  Phase  II  STTR 


Personnel 

Affiliation 

Dr.  William  Constantine  (PI) 

Insightful 

Dr.  Donald  Percival 

Insightful 

Dr.  John  Lu 

Insightful 

Prof.  Per  Reinhall  (PI,  UW) 

U.  OF  Wash.  (M.E.) 

Prof.  James  Bassingthwaighte 

U.  OF  Wash.  (Bioengineering) 

Dr.  Peter  Craigmile 

U.  OF  Wash.  (Stat.) 

Gerry  Pag  el 

U.  OF  Wash.  (M.E.) 
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2.5  Interactions/Transitions 

The  technology  produced  by  this  STTR  has  been  leveraged  primarily  by  our 
rapidly  growing  consulting  department,  particularly  in  the  area  of  finance. 
Wavelet  techniques  have  played  an  important  role  in  time-scale  analysis  of 
financial  time  series  for  our  clients,  such  as  Deutsche  Bank  and  Lincoln 
Capital,  who  are  preparing  for  the  onset  of  a  fully  automated  electronic 
trading  environment.  These  real-time  environments  call  for  robust  scale- 
and  time-based  modeling  schemes.  The  revenue  generated  by  our  (wavelet- 
based)  consulting  for  financial  institutions  is  estimated  at  $300,000  for  a 
12-month  period  within  the  years  2000-2001.  We  expect  this  market  to 
grow  to  over  $500,000  in  2002. 

3  Software 

Here  we  describe  the  C  library  used  to  developed  S-j- WAVELETS.  The  man¬ 
ual  for  the  ‘beta’  version  of  S-h Wavelets  is  attached  as  an  appendix  to 
this  report. 

3.1  MUTILS  C  Library  Function  List 

A  majority  of  the  base  software  was  written  in  C  for  speed  and  portability. 
The  naming  convention  for  each  is  based  on  a  strict  prototype  used  by 
Insightful  for  its  in-house  signal  and  image  processing  libraries  known  as 
MUTILS. 

Wavelet  Transforms 

•  wavuniv_transform_discrete_wavelet_convolution:  Implemen¬ 

tation  of  discrete  wavelet  transform  using  convolution  style  filtering 
with  periodic  boundary  extension. 

•  wavuniv-transform^discrete_wavelet_convolutioii_inverse:  In¬ 
verse  discrete  wavelet  transform  using  convolution  style  filtering. 

•  wavuniv-.transform_niaximum_overlap:  Maximal  overlap  discrete 
wavelet  transform. 

•  wavuniv-transforimnaximum-overlap-inverse:  Inverse  maximal 
overlap  discrete  wavelet  transform. 
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•  wavuniv_transform_maximuni_overlap-packet:  Maximal  overlap 
discrete  wavelet  packet  transform. 

•  wavuniv_transforni_packet:  Discrete  wavelet  packet  transform  with 
convolution  style  filtering. 

•  wavuniv^transform-packet-detail:  Detail  sequence  calculation  for 
the  discrete  wavelet  transform,  the  discrete  wavelet  packet  transform, 
the  maximal  overlap  discrete  wavelet  transform  and  the  maximal  over¬ 
lap  discrete  wavelet  packet  transform. 

Wavelet  Filter  and  Coefficient  Indexing  Functions 

•  wavuniv^coefficient -boundaries:  Boundary  and  interior  wavelet 
coefficient  identification  for  the  discrete  wavelet  transform  and  the 
maximal  overlap  discrete  wavelet  transform. 

•  wavunivJfilters-daubechies:  Daubechies  wavelet  and  scaling  filters. 

•  wavuniv Jilters-daubechies-gain:  Gain  functions  for  Daubechies 
wavelet  and  scaling  filters. 

•  wavuniv-filters-daubechies-verify:  Verification  of  general  filters 
as  Daubechies  filter  sets. 

•  wavuniv-Coefficient_zero_phase:  Shift  factors  for  achieving  approx¬ 
imate  zero  phase  for  Daubechies  symmlet  and  Coiflet  filters. 

Statistical  Functions  for  Wavelets 

•  wavdbl-digamma:  Digamma  function:  first  derivative  of  the  natural 
logarithm  of  the  Euler  Gamma  function. 

•  wavdbl-trigamma:  Trigamma  function:  second  derivative  of  the 
natural  logarithm  of  the  Euler  Gamma  function. 

•  wavuniv_statistic_acvs:  Single-sided  autocovariance  sequence. 

•  wavuniv-variance_confidence:  Confidence  intervals  for  the  biased 
and  blocked  averaged  discrete  wavelet  variance  estimates. 

•  wavuniv-variance-Confidence_edof:  Equivalent  degree  of  freedom 
estimates  for  a  chi-squared  distribution  assumption  on  the  interior 
wavelet  coefficients. 
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•  wavuniv-statistic-interpolation  Jinear:  Table  lookup  using  linear 
interpolation  for  1-D  matrices. 

Wavelet  Functions  for  Fractionally  Differenced  Processes 

•  wavunivJPdp -bandpass -Variance:  Integration  of  spectral  density 
function  using  a  mid-octave  approximation. 

•  wavuniv-fdp -estimator -instantaneous:  Instantaneous  and  local¬ 
ized  maximum  likelihood  estimation  and  least  squares  estimation  of 
fractionally  differenced  model  parameters. 

•  wavunivJdp-estimator-block:  Block  dependent  maximum  likeli¬ 
hood  estimation  and  weighted  least  squares  estimation  of  fractionally 
differenced  model  parameters. 

•  wavuniv-fdp jsimulate:  Exact  time-varying  fractionally  differenced 
process  simulation. 

•  wavuniv-fdp^imulate-weights:  Circulant  embedding  weights  used 
to  generate  exact  simulations  of  time-varying  fractionally  differenced 
processes. 

These  functions  represent  a  major  subset  of  the  code  developed  thus 
far  in  C.  For  each  C  function  listed  above,  a  set  of  wrapper  functions  (one 
in  C  and  one  in  S-PLUS)  was  developed  so  that  the  the  C  code  can  be 
loaded  from  S-PLUS.  These  “wrapped”  functions  replace  the  prototypes 
developed  purely  in  S-PLUS  for  phase  I.  As  expected,  the  conversion  to  C 
has  increased  the  computational  speed  considerably  (we  note,  for  example, 
that  the  instantaneous  maximum  likelihood  estimation  of  FD  parameters 
for  a  512  point  time  series  has  decreased  from  an  average  of  180  seconds  in 
S-PLUS  to  approximately  0.25  seconds  in  C;  a  720-fold  increase  in  speed). 

For  every  function  in  S-PLUS  a  help  function  has  been  written  to  aid  the 
user  in  understanding  the  code.  The  C  code  help  is  automatically  generated 
using  in-house  routines  which  port  the  header  information  to  HTML  and 
LaTeX  formats.  Finally,  for  each  S-PLUS  function  we  have  written  so- 
called  “loop  tests”  which  test  both  the  functionality  and  values  generated. 
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Appendix  A:  S+Wavelets  2.0  Manual 

The  pages  following  this  one  contain  the  ‘beta’  version  of  S+Wavelets. 
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Introduction 


1.1  Advantages  of  New  Wavelet  Transforms 

Ll.l  Discrete  Wavelet  Transforms 

In  this  version  of  the  S-h Wavelets  module  we  introduce  a  variety  of  new 
discrete  wavelet  transforms  based  on  those  developed  in  [PWOO]  and  in 
[Kin98,  Kin99,  KinOO].  Previous  versions  of  the  S+Wavelets  module  support 
similar  transforms,  but  there  are  some  distinct  differences  between  old  and 
new. 

•  Identification  of  boundary  coefficients.  For  finite  length  time 
series,  there  are  a  number  of  methods  used  to  extend  the  bound¬ 
aries  of  a  sequence  in  order  to  preserve  the  length  of  the  time  se¬ 
ries  in  the  transform.  The  number  of  coefficients  that  are  influenced 
by  these  boundary  treatments  grows  with  the  decomposition  level. 
It  is  important  to  keep  track  of  these  so-called  “boundary”  coeffi¬ 
cients  when  applying  statistical  measures  to  the  wavelet  transform 
coefficients  e.g.  wavelet  variance  estimators.  While  former  versions  of 
the  S-h  Wavelets  module  offer  a  variety  of  boundary  treatments,  there 
currently  exists  no  methodology  to  track  the  corresponding  boundary 
coefficients.  In  the  new  S-h  Wavelets  module,  we  have  embedded  func¬ 
tionality  to  track  the  boundary  coefficients,  enabling  us  to  calculate 
cross-scale  unbiased  statistics  on  the  transform  coefficients. 

•  Assurance  of  energy  preservation.  In  orthonormal  transforms, 
the  energy  of  the  original  time  series  is  equal  to  that  of  the  collec- 
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tive  transform  coefficients.  In  forming  certain  statistics  of  the  wavelet 
transform  coefficients,  it  is  vital  that  the  energy  be  preserved.  To 
guarantee  energy  preservation,  the  wavelet  transforms  in  the  new 
Sd-Wavelets  module  impose  a  periodic  boundary  extension  rule.  Other 
existing  boundary  extension  treatments  such  as  polyO,  polyl,  poly2,zero, 
and  reflection  do  noi  guarantee  energy  conservation  in  the  transform. 

•  Handling  non-dyadic  time  series.  A  time  series  is  dyadic  if  its 
length  is  a  power  of  two.  The  definition  of  a  discrete  wavelet  trans¬ 
form  is  typically  based  on  the  assumption  that  the  time  series  is 
dyadic  and,  in  order  to  overcome  this  restriction,  special  techniques 
must  be  used.  In  the  former  S+Wavelets  modules,  the  wavelet  trans¬ 
forms  handled  non-dyadic  time  series  in  a  way  that  made  the  number 
of  transform  coefficients  at  a  given  level  difficult  for  the  user  to  pre¬ 
dict.  In  the  new  S-hWavelets  module,  we  use  a  novel  treatment  for 
non-dyadic  sequences  that  follows  a  simple  rule  applied  only  to  the 
transform  coefficients  corresponding  to  low  pass  filter  operations,  i.e. 
the  so-called  scaling  coefficients:  if  at  any  given  decomposition  levels 
the  number  of  scaling  coefficients  is  odd,  then  the  last  scaling  coeffi¬ 
cient  is  preserved  in  a  special  crystal  named  extra.  For  reconstruction 
(synthesis)  operations,  the  extra  scaling  coefficients  are  simply  put 
back  into  place  at  the  appropriate  point  in  the  reconstruction  algo¬ 
rithm.  While  this  technique  requires  a  bit  more  bookkeeping  (on  our 
part),  it  does  not  impose  any  spurious  energy  in  the  transform  coeffi¬ 
cients.  Furthermore,  the  number  of  coefficients  at  each  level  is  easily 
calculable. 

•  Convolution  style  filtering.  Prior  to  this  version  of  S-fWavelets, 
the  default  filtering  style  was  correlation.  In  the  new  wavelet  trans¬ 
forms,  the  filtering  style  is  convolution.  Both  are  valid  means  of  ob¬ 
taining  wavelet  transform  coefficients,  but  the  convolution  style  has 
the  advantage  of  being  easily  related  to  the  discrete  Fourier  trans¬ 
form.  The  relation  we  speak  of  states  that  the  convolution  of  a  time 
series  and  a  filter  in  the  time  domain  is  equivalent  to  the  (inverse 
Fourier  transform  of)  the  product  of  the  filter  and  time  series  in  the 
frequency  domain. 

We  also  introduce  a  new  discrete  wavelet  transform  to  the  S-hWavelets 
module:  the  dual  tree  wavelet  transform  (DTWT)  developed  by  Dr,  N.G. 
Kingsbury  of  the  University  of  Cambridge.  Like  non-decimated  wavelet 
transforms,  the  DTWT  is  an  over-complete  transformation  of  the  data, 
producing  more  transform  coefficients  than  that  found  in  the  original  data. 
The  redundancy  is  a  factor  of  2  in  one  dimension,  and  4  in  two  dimen¬ 
sions.  By  comparison,  conventional  non-decimated  DWTs  impose  a  J-fold 
increase  in  the  number  of  coefficients  for  (one-dimensional)  time  series, 
where  J  is  the  decomposition  level.  The  advantages  of  the  DTWT  are  that 
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it  retains  perfect  reconstruction,  achieves  a  good  (approximate)  degree  of 
shift  invariance,  has  good  directional  selectivity,  and  has  low  noise  ampli¬ 
fication,  all  at  the  cost  of  a  modest  degree  of  redundancy.  The  DTWT  is 
available  for  both  1-D  and  2-D  transformations. 

A  number  of  promising  applications  of  the  DTWT  have  been  reported 
in  the  recent  literature  by  Kingsbury  and  his  co-workers.  We  summarize 
several  of  these  here  as  an  indication  of  the  potential  and  versatility  of  this 
transform. 

•  In  video  coding,  because  transforms  of  shifted  images  are  simply  re¬ 
lated,  motion  vectors  between  successive  video  frames  may  be  esti¬ 
mated  by  analysis  in  the  transform  domain  [MK98]. 

•  In  image  denoising,  application  of  soft  thresholding  to  the  complex 
wavelet  coefficients  produces  results  comparable  to  those  obtained 
using  the  non-decimated  transform  (MODWT),  but  with  consider¬ 
ably  less  computation  [Kin98].  The  denoising  performance  may  be 
enhanced  by  use  of  hidden  Markov  tree  (HMT)  methods  [CRKOO]. 

•  In  texture  analysis,  the  directional  and  shift-invariant  features  of  the 
DTWT  make  it  ideal  [HMK99,  dRK99,  HBOO]. 

•  In  image  classification,  techniques  can  be  based  on  multiscale  tex¬ 
ture  and  color  feature  vectors  obtained  from  the  DTWT  [KNKFOO, 
RCBKOO,  dRKOO]. 

•  In  digital  image  watermarking,  a  promising  method  can  be  based  on 
the  DTWT  [LKOO]. 

LI. 2  Continuous  Wavelet  Transforms 

The  new  S -{-Wavelets  contains  two  new  continuous  wavelet  transforms:  the 
continuous  wavelet  transform  (CWT)  and  the  Gabor  transform  (2-D  only). 


1.2  Estimation  of  the  Wavelet  Variance 

In  this  version  of  S-fWavelets,  we  introduce  functionality  to  estimate  the 
wavelet  variance  of  a  time  series  and  to  provide  corresponding  confidence 
intervals.  The  wavelet  variance  provides  a  way  of  analysing  (decomposing) 
the  variance  of  a  time  series  and  is  of  interest  for  several  reasons. 

•  The  wavelet  variance  breaks  up  the  variance  of  certain  stochastic 
processes  into  pieces  that  are  associated  with  different  scales.  This 
type  of  decomposition  has  considerable  appeal  for  studying  time  series 
that  exhibit  fluctuations  over  a  range  of  different  scales,  as  occurs 
quite  commonly  in  financial  and  geophysical  time  series. 
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•  The  wavelet  variance  is  closely  related  to  the  concept  of  the  spec¬ 
tral  density  function  (SDF),  While  the  SDF  decomposes  the  variance 
of  a  process  into  components  that  can  be  associated  with  particular 
frequencies,  the  wavelet  variance  decomposes  the  variance  into  com¬ 
ponents  associated  with  particular  scales.  Since  each  scale  can  in  turn 
be  related  to  a  certain  range  of  frequencies  in  the  data  (as  opposed 
to  a  single  frequency),  the  wavelet  variance  often  leads  to  a  more 
succinct  decomposition  that  is  easier  to  interpret. 

•  The  wavelet  variance  is  a  useful  substitute  for  the  variance  of  a  process 
for  certain  processes  with  infinite  variance  or  for  a  process  whose 
sample  variance  has  poorly  behaved  sampling  properties. 

1.3  Wavelet-Based  Analysis  of  Fractionally 
Differenced  Processes 

Recently  there  has  been  wide-spread  interest  in  the  use  of  non-stationary 
multi-scale  fractal  processes  as  models  for  environmental,  biomedical  and 
financial  time  series.  There  are,  however,  a  number  of  modeling  and  esti¬ 
mation  issues  that  have  yet  to  be  fully  resolved.  In  the  area  of  modeling 
there  is  need  for  a  flexible  -  yet  tractable  -  class  of  models  that  are  ca¬ 
pable  of  describing  the  non-stationarities  typically  observed  in  recorded 
mecisurements  of  (fractal)  processes.  The  challenge  is  to  develop  models 
that  capture  the  salient  features  of  fractal  times  series,  yet  do  so  in  a  rel¬ 
atively  simple  manner.  One  such  model  is  the  a  fractionally  differenced 
(FD)  process.  For  certain  fractal  processes,  an  FD  process  model  has  many 
advantages  over  conventional  models  (such  as  fractional  Brownian  motion 
and  fractional  Gaussian  noise  models)  including  model  flexibility,  simplicity 
and  continuity  over  stationary-nonstationary  model  parameter  regimes. 

The  S+ Wavelets  module  utilizes  novel  wavelet-based  techniques  to  esti¬ 
mate  the  (possibly  time- varying)  FD  model  parameters  over  finite  ranges 
of  scale.  Wavelet  methods  have  many  advantages  over  other  techniques: 

•  Decomposition  based  on  scale.  Many  real-world  (fractal)  phe¬ 
nomena  exhibit  fluctuations  at  various  temporal  or  spatial  scales,  e.g. 
atmospheric  turbulence  measurements,  financial  market  fluctuations, 
and  environmental  time  series  to  name  a  few.  A  wavelet  transform 
is  a  natural  analyzer  for  such  data  since  it  transforms  a  time  series 
into  coefficients  that  correspond  to  (differences  and  averages)  of  such 
variations  over  a  range  of  different  scales. 

•  Decorrelation  of  time  series.  Many  fractal  processes,  such  as 
long-memory  processes,  are  highly  correlated.  In  this  case,  estimat¬ 
ing  the  FD  model  parameters  via  a  maximum  likelihood  estimator 
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(MLE)  is  computationally  intense,  but  is  relatively  efficient  for  un¬ 
correlated  fractal  processes.  Craigmile  et  al  show  that  using  a  DWT 
on  correlated  FD  process  realizations  yields  wavelet  coefficients  that 
are  approximately  uncorrelated  [CPGOOa].  Thus,  to  make  MLE  of  FD 
model  parameters  practical,  the  DWT  can  be  used  as  a  preprocessive 
measure  to  decorrelate  correlated  FD  processes. 

•  Localized  time  and  scale  content.  Each  wavelet  coefficient  is 
localized  in  time,  allowing  us  to  track  changes  in  the  characteristics 
of  a  time  series  at  a  particular  scale  as  a  function  of  time. 

•  Separation  of  nonlinear  trends  from  noise.  The  wavelet  co¬ 
efficients  are  inherently  ‘blind’  (invariant)  to  nonlinear  polynomial 
trend  contamination  in  the  original  time  series  [CPGOOb]. 

In  addition  to  its  FD  estimation  routines,  the  S-h Wavelets  module  con¬ 
tains  functionality  for  simulating  time-varying  fractionally  differenced  (TVFD) 
processes.  TVFD  processes  can  serve  as  useful  models  for  certain  time  se¬ 
ries  whose  statistical  properties  evolve  over  time.  The  TVFD  functionality 
developed  for  S+Wavelets  has  many  advantages  over  other  techniques: 

•  The  FD  model  parameters  are  allowed  to  fluctuate  as  a  function  of 
time.  This  is  beneficial  for  modeling  some  real-world  processes  which 
exhibit  fluctuating  stochastic  fractal  dynamics  as  time  evolves. 

•  The  TVFD  routines  generate  mathematically  “exact”  realizations, 
thus  ensuring  that,  if  we  conducted  a  Monte  Carlo  experiment  to 
determine  the  properties  of  a  statistic  formed  from  a  TVFD  process, 
our  results  will  reflect  the  correct  properties  of  the  statistic  rather 
than  the  inaccuracies  in  the  simulation  technique. 

•  The  range  of  supported  TVFD  model  parameters  exceeds  that  of 
(related)  model  parameters  for  other  techniques  such  as  locally  sta¬ 
tionary  processes  [Pri65,  Dah97,  MPZ98,  CHT98,  Mal99]  and  locally 
self-similar  process  [GF93,  FG94,  WCSOl].  Although  these  classes 
have  served  as  successful  models  for  some  time  series,  the  correspond¬ 
ing  restricted  model  parameter  range  are  not  reasonable  for  certain 
real-world  time  series,  whereas  the  range  for  our  TVFD  simulator  is 
appropriate  for  most  (if  not  all)  real-world  phenomena. 


1.4  Organization  of  Supplement 

The  remainder  of  this  S+Wavelets  module  is  organized  as  follows: 

In  §2  we  introduce  the  filter  functions  used  to  generate  suitable  wavelet 
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and  scaling  filters  for  use  in  discrete  wavelet  transforms.  In  §3  we  discuss 
both  one-dimensional  and  two-dimensional  discrete  wavelet  transforms  and 
the  parameters  needed  to  fine-tune  their  output.  In  §4  we  introduce  the 
concept  of  wavelet  variance  and  discuss  its  ramifications  on  scale  selection 
and  FD  model  validation.  In  §5  we  introduce  FD  model  simulation  and 
estimation  functions  and  present  show  its  potential  in  analyzing  both  sim¬ 
ulated  and  physical  stochastic  fractal  process  realizations.  In  Appendix  A 
and  Appendix  B  we  provide  the  data  and  function  references,  respectively, 
for  the  S-1- Wavelets  module.  In  Appendix  C  we  define  the  object-oriented 
design  of  the  S+Wavelets  module  and  include  a  description  of  classes  and 
corresponding  methods. 
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Filter  Functions 


2.1  What  is  a  Wavelet  Filter? 

Qualitatively  speaking,  a  function  defined  over  the  entire  real  axis  is 

called  a  wavelet  (or  ‘short  wave’)  if  0  as  t  ±oo.  For  a  contrasting 

example,  consider  a  function  whose  value  at  t  is  given  by  cos(27rt/10). 
Because  this  function  has  no  tendency  to  get  smaller  as  t  gets  larger  and 
larger,  we  can  call  it  a  ‘long  wave.’  By  judiciously  defining  a  wavelet  and 
by  comparing  it  to  various  portions  of  another  continuous  function  of  we 
can  expose  or  extract  variations  in  portions  of  this  second  function  over 
the  effective  width  (i.e.,  scale  or  duration)  of  the  wavelet. 

In  practical  applications,  we  invariably  deal  with  sequences  of  values 
indexed  by  integers  rather  than  functions  defined  over  the  entire  real  axis 
(such  sequences  are  often  called  ‘time  series’  for  convenience).  In  place  of 
actual  wavelets,  we  use  short  sequences  of  values  referred  to  as  wavelet 
filters.  The  number  of  values  in  the  sequence  is  called  the  width  of  the 
wavelet  filter.  For  technical  recisons,  this  width,  denoted  by  L,  must  be  an 
even  integer.  We  use  the  notation  (or  just  {hi})  to  denote  a  wavelet 

filter,  where  hi  is  called  a  filter  coefficient  (the  set  of  all  filter  coefficients  is 
commonly  called  the  impulse  response  sequence).  Quantitatively,  a  wavelet 
filter  must  meet  the  following  three  mathematical  conditions. 

1.  The  filter  coefficients  must  sum  to  zero: 

L-l 

52  (.,=0. 

/=o 
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2.  The  coefficients  must  have  unit  energy: 


L-\ 


=  1. 


3.  The  coefficients  must  be  orthogonal  to  their  even  shifts: 


L-l 

hihi^2k  =  0) 

/=0 

where  k  is  any  nonzero  integer,  and  for  convenience  we  define  hi=0 
for  /  <  0  or  Z  >  L. 

Together  the  second  and  third  conditions  are  called  the  orthonormality 
condition. 

The  wavelet  filter  is  used  in  combination  with  a  scaling  filter  to  calculate 
a  discrete  wavelet  transform.  The  wavelet  filter  coefficients  hi  are  related  to 
the  scaling  filter  coefficients  gi  through  a  quadrature  mirror  filter  (QMF) 
relationship,  namely, 

gi  —  Z  =  0, 1. 

Given  a  scaling  filter,  we  can  obtain  the  corresponding  wavelet  filter  via 
hi  =  {-lYgi^i^i,  The  scaling  filter  satisfies  the  same  orthonormality  con¬ 
dition  as  the  wavelet  filter,  but,  rather  than  summing  to  zero,  we  have 
Y^i  9t  =  The  scaling  filter  and  wavelet  filter  are  sometimes  referred  to 
in  wavelet  literature  as  the  ‘father  wavelet  filter’  and  ‘the  mother  wavelet 
filter.’ 


2.2  Supported  Wavelet  Filters 

There  are  several  families  of  wavelet  filters  whose  members  satisfy  the  three 
mathematical  conditions  stated  above.  The  following  four  families  are  sup- 
ported  in  S+Wavelets. 

•  EXTREMAL  PHASE  (d):  Filters  in  this  family  are  designed  such 
that,  if  we  use  an  impulse  as  the  input,  then  the  output  from  the 
filter  will  have  a  cumulative  energy  that  increases  as  fast  as  possible. 
Extremal  phase  filters  are  also  know  as  ‘daublets’  or  ‘minimum  phase’ 
filters. 

•  LEAST  ASYMMETRIC  (s):  Filters  in  this  family  are  smoother  and 
more  symmetric  looking  than  extremal  phase  filters,  but  they  have 
exactly  the  same  gain  functions  (i.e.,  the  magnitudes  of  their  discrete 
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Fourier  transforms).  These  filters  are  approximations  to  linear  phase 
filters  (a  filter  with  linear  phase  is  desireable  because  we  can  then 
match  up  patterns  going  into  the  filter  with  those  coming  out).  They 
are  also  known  as  ‘symmlets’. 

•  BEST  LOCALIZED  (1):  These  filters  have  the  same  gain  functions 
are  the  extremal  phase  and  least  asymmetric  filters.  Like  the  latter, 
they  are  intended  to  be  as  symmetric  as  possible,  but  they  use  a 
slightly  different  definition  of  what  constitutes  good  symmetry. 

•  COIFLET  (c):  These  filters  have  different  gain  functions  from  the 
other  three  families  and  are  much  better  approximations  to  linear 
phase  filters. 

The  extremal  phase,  least  asymmetric  and  coiflet  families  of  wavelet  fil¬ 
ters  are  discussed  in  detail  in  the  pioneering  book  on  wavelets  by  Ingrid 
Daubechies  [Dau92].  She  coined  the  term  ‘coiflet’  in  honor  of  Ronald  Coif- 
man  (another  prominent  ‘waveletician’),  to  whom  she  credits  the  idea  for 
the  family.  The  best  localized  family  is  due  to  Doroslovacki  [Dor98]. 


2.3  The  WaveletDaubechies  Filter  Object 

The  wavDaubechies  function  retrieves  wavelet  and  scaling  filters  and  returns 
them  in  the  form  of  an  object  of  class  WaveletDaubechies.  The  following 
methods  can  be  used  to  view,  summarize  and  access  the  data  contained  in 
a  WaveletDaubechies  object. 

Summary  Operator  Methods: 

Prints  the  following  information  about  the  wavelet  and 
scaling  filters; 

•  the  filter  type  (e.g.  ‘Extremal  Phase’) 

•  the  width  L  of  the  wavelet  and  scaling  filters 

•  a  logical  flag  stating  the  normalization  status  of 
the  filters 

•  the  coefficients  (i.e.,  impulse  response  sequence) 
for  the  filters 

Plots  the  coefficients  for  wavelet  and  scailing  filters 
or  components  of  their  frequency  response  functions 
(these  functions  are  the  discrete  Fourier  transforms 
of  the  filter  coefficients  and  are  also  commonly  called 


print 


plot 
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the  transfer  functions).  The  plot  function  takes  a  sec¬ 
ond  argument  (type),  which  should  be  set  to  the  string 
’’time”,  ’’gain",  or  "phase”  to  plot,  respectively,  the  fil¬ 
ter  coefficients,  the  gain  function  (i.e.,  the  modulus  of 
the  frequency  response  function)  and  the  phase  of  the 
frequency  response  function. 

Data  Access  Methods 


$  Use  to  access  specific  components  of  the  class  object. 

A  list  of  accessible  components  can  be  generated  using 
the  names  function. 

For  example,  if  s8  is  an  object  of  class  WaveletDaubechies, 
then  names(s8)  will  give  a  list  of  its  components.  Two 
of  these  components  are  wavelet  and  scaling,  so  s8$wave!et 
will  return  the  wavelet  filter  coefficients,  while  s8$scaling 
will  return  the  scaling  filter  coefficients. 


2.4  An  Example:  Retrieving  Wavelet  and  Scaling 
Filters 

To  retrieve  a  particular  wavelet  filter,  use  the  wavDaubechies  function  along 
with  a  string  denoting  the  desired  filter.  This  string  should  start  with  either 
d  (for  extremal  phase  filters,  i.e.,  daublets),  s  (for  least  asymmetric  filters, 
i.e.,  symlets),  I  (for  best  localized  filters)  or  c  (for  coiflets)  and  should  be 
followed  by  the  width  of  the  desired  filter.  The  wavDaubechies  function  also 
takes  an  optional  second  argument,  which  is  a  logical  flag  used  to  denote 
whether  the  filters  should  be  unnormalized  or  normalized  (the  default). 
Filters  with  unit  energy  are  not  considered  to  be  normalized  —  normalized 
filters  have  energies  of  0.5  and  are  used  with  the  ‘maximal  overlap’  version 
of  the  discrete  wavelet  transform  described  in  §3.2) 
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>  s8  <-  wavDaubechiesC'sS'* ,  norm=F) 

>  s8 

Filter  type:  Least  Asymmetric 

Filter  length:  8 

Filter  normalized:  FALSE 

Wavelet  filter: 

[1]  0,03222310  0.01260397  -0.09921954  -0.29785780 
[5]  0.80373875  -0.49761867  -0.02963553  0.07576571 


Scaling  filter: 

[1]  -0.07576571  -0.02963553  0.49761867  0.80373875 
[5]  0.29785780  -0.09921954  -0.01260397  0.03222310 

The  wavelet  and  scaling  filter  coefficients  are  returned  embedded  in  an 
object  of  class  WaveletDaubechles.  As  shown  in  the  example  above,  the 
print  method  for  this  class  lists  exactly  what  filters  these  are  and  their 
normalization  status,  following  which  it  gives  the  coefficients  (i.e.,  impulse 
response  sequence)  for  both  filters.  As  an  example  of  accessing  one  of  the 
components  in  the  object  s8,  let  us  check  that  the  wavelet  filter  coefficients 
have  unit  energy: 

>  sum(s8$wavelet"2) 

[1]  1 

Use  the  plot  method  to  view  the  filter  coefficients  (i.e.,  impulse  response 
sequence)  and  the  components  of  their  frequency  response  functions: 

>  plot  (wavDaubechies(*'s20‘' ,  norm=F) ,  type="time") 

>  plot (wavDaubechies("s20'’ ,  norm=F) ,  type="gain") 

>  plot (wavDaubechies ("s20" ,  norm=F) ,  type="phase") 

The  gain  functions  reveal  that  the  wavelet  and  scaling  filters  are  high  and 
low  pass  filters,  respectively. 
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IMPULSE  RESPONSE:  Least  Asymmetric,  length  =  20 


FIGURE  2.1.  Filter  coefficients  (i.e.,  impulse  response  sequence)  for  Daubechies 
least  asymmetric  wavelet  and  scaling  filters  of  width  L  =  20. 
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FREQUENCY  RESPONSE  GAIN:  Least  Asymmetric,  length  =  20 


FIGURE  2.2.  Gain  functions  (i.e.,  modulus  of  the  frequency  response  functions) 
for  Daubechies  least  asymmetric  wavelet  and  scaling  filter  of  width  L  =  20. 
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FREQUENCY  RESPONSE  PHASE:  Least  Asymmetric,  length  =  20 


Normalized  Frequency 

FIGURE  2.3.  Phase  of  frequency  response  functions  for  Daubechies  least  asyi 
metric  wavelet  and  scaling  filter  of  width  L  =  20.  The  vertical  axis  is  express 
in  degrees. 
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3.1  The  Discrete  Wavelet  Transform 

3.1.1  Overview 

The  wavelet  filter  {hi]  and  scaling  filter  [gi]  discussed  in  §2  are  used  to  cre¬ 
ate  a  discrete  wavelet  transform  (DWT),  which  maps  a  time  series  from  its 
original  representation  in  the  time  domain  to  an  alternative  representation 
in  the  time-scale  domain.  The  DWT  is  implemented  in  the  time  domain  by 
recursively  applying  both  filters  to  the  time  series  in  a  ‘pyramid’  algorithm. 
Each  recursive  use  of  these  filters  yields  one  level  of  wavelet  coefficients  and 
scaling  coefficients.  If  we  stop  after  reaching  a  particular  level,  say  J ,  and  if 
the  sample  size  N  of  our  time  series  can  be  expressed  as  an  integer  multiple 
of  2-^,  the  DWT  consists  of  the  wavelet  coefficients  for  levels  j  =  1, 2, . . . ,  J 
along  with  the  scaling  coefficients  for  level  J.  If  we  let  dj  and  sj  repre¬ 
sent  the  collection  of  wavelet  and  scaling  coefficients,  respectively,  at  level 
j,  we  can  represent  the  DWT  for  level  J  as  [dl|d2| . . ,  jdJjsJ].  We  use  the 
term  ‘crystal’  to  refer  to  any  one  of  the  components  dl,  d2,  ...dJ,  sJ  in 
the  DWT;  i.e.,  a  level  J  DWT  consists  of  J  +  1  crystals,  J  of  which  are 
the  wavelet  coefficients  at  the  J  different  levels,  and  one  of  which  contains 
the  scaling  coefficients  for  level  J.  (If  N  is  not  an  integer  multiple  of  2*^, 
an  extra  cystral  is  needed.  This  consists  of  at  most  one  scaling  coefficient 
from  levels  j  =  1, . . . ,  J  -  1.  In  this  case,  we  can  represent  the  DWT  as 
[dl|d2| . . .  |dJlsJ|extra].) 

As  an  example,  let’s  consider  a  linear  chirp,  i.e.,  a  sinusoid  whose  fre¬ 
quency  increases  linearly  with  time. 


linchirp 
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FIGURE  3.1.  A  1024  point  sample  of  a  linear  chirp. 
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>  linchirp  <-  make . signal (  "linchirp",  n=1024  ) 

>  plot(  linchirp,  type="l",  ylab=” linchirp”  ) 

Figure  3.1  shows  the  resulting  plot.  You  can  use  the  wavDWT  function  to 
calculate  a  level  J  =  4  DWT  using  the  s8  wavelet  filter,  i.e,,  the  Daubechies 
least  asymmetric  filter  of  width  L  =  S. 

>  dwt. linchirp  <“  wavDWT(  linchirp,  wavelet=”s8” ,  n.levels=4  ) 

>  dwt. linchirp 

Discrete  Wavelet  Transform  of  linchirp 
Wavelet:  s8 

Length  of  series:  1024 

Number  of  levels:  4 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Shifted  for  approximate  zero  phase:  FALSE 

Crystals:  dl  d2  d3  d4  s4 

To  plot  the  DWT,  simply  invoke  the  plot  method: 

>  plot(  dwt. linchirp  ) 

Figure  3.2  is  a  plot  of  the  elements  of  each  crystal  versus  a  nominal  position 
(positions  0  to  1024  correspond  to  times  0  to  1;  §3.1.4  below  discusses  a 
refinement  for  associating  the  values  in  each  crystal  with  a  particular  time). 

If  we  compare  this  figure  with  Fig.  3.1,  we  see  that,  as  the  level  of  the 
wavelet  coefficients  increases,  the  positions  of  its  largest  elements  are  shifted 
toward  the  beginning  of  the  series.  As  we  discuss  in  §3.1.3  below,  this  is  in 
keeping  with  a  band-pass  interpretation  of  the  DWT  in  which  the  high  level 
wavelet  coefficients  are  capturing  information  in  a  time  series  over  certain 
bands  of  low  frequencies.  The  frequencies  in  our  linear  chirp  are  increasing 
with  time,  which  implies  that  the  positions  of  large  wavelet  coefficients 
should  shift  to  the  left  as  the  level  increases  -  this  is  in  agreement  with 
Fig.  3.2.  Similarly  the  scaling  coefficients  capture  the  very  lowest  frequency 
information  about  our  time  series,  which  is  also  consistent  with  what  is 
shown  in  Fig.  3.2. 

We  can  easily  access  the  components  (i.e.,  crystals)  of  a  DWT.  For  ex¬ 
ample,  the  wavelet  coefficients  for  level  4  are  in  the  crystal  named  d4.  You 
can  access  these  coefficients  by  using  dwt.linchirp[[”d4”]].  This  is  done  in 
the  following  command,  in  which  we  calculate  the  ‘energy’  in  the  level  4 
wavelet  coefficients  (i.e.,  the  sum  of  squares  of  all  the  elements  in  d4). 
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>  sujn(  (iwt.linchirp[["d4"]]  "2  ) 

[1]  130.638 

The  energy  in  particular  crystals  is  of  interest  because  the  DWT  is  an 
‘energy  preserving  transform’;  i.e.,  the  energy  in  all  the  DWT  coefficients 
is  equal  to  the  energy  in  the  original  time  series.  We  can  verify  that  this  is 
true  numerically  here. 

>  sum(  unlist (lapplyCdwt .  linchirp$(iat a, 

+  function(x)  suin(x"2)))  ) 

[1]  500.6865 

>  suin(  1  inchirp  "2  ) 

[1]  500.6865 

The  fact  that  the  DWT  preserves  energy  means  that  we  can  use  it  to 
analyze  the  variance  in  a  time  series  (this  fact  is  exploited  in  detail  in  §4). 

In  addition  to  the  plot  method,  we  can  use  the  summary  method  to  get 
some  summary  statistics  about  the  DWT  coefficients. 
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>  summary (  dwt . 1 inchirp  ) 


Min 

dl  -0.144  -0 
d2  -1.265  -0 
d3  -2.529  -0 
d4  -3.585  -0 
s4  -3.711  -0 


IQ  Median 
005  0.000 
103  0.000 
615  -0.001 
820  -0.001 
120  0.004 


3Q  Max 
0.005  0.130 
0.091  1.271 
0.603  2.629 
0.171  3.212 
0.252  4.028 


Mean  SD  Var 
0.000  0.037  0.001 
0.001  0.425  0.181 
-0.035  1.236  1.529 
-0.224  1.422  2.023 
0.120  1.426  2.033 


MAD  Energy  '/, 

0,008 

0.141 

0.146 

9.194 

0.918 

38.804 

0.661 

26.092 

0.283 

25.769 

Energy  Distribution: 

1st  ly.  n  n  n  sy.  loy. 

Energy  */.  3.240  25.682  39.772  51.277  61.146  69.638  89.481 

Icoeffsl  4.028  2.966  2.494  2.315  2.110  1.865  1.042 

#coeffs  1.000  11.000  21.000  31.000  41.000  52.000  103.000 


15’/,  20y.  25'/. 

Energy  '/.  96.233  98.793  99.589 

Icoeffsl  0.637  0.361  0.213 

#coeffs  154.000  205.000  256.000 

The  first  block  of  the  summary  gives  some  statistics  related  to  the  empirical 
distribution  of  the  values  within  each  crystal  (minimum  value,  first  quar- 
tile,  median  (i.e.,  second  quartile),  third  quartile,  maximum  value,  mean, 
standard  deviaton,  sample  variance  and  the  median  absolute  deviation), 
along  with  the  percentage  of  the  total  energy  in  the  time  series  trapped 
within  each  crystal.  You  can  also  look  at  the  energy  distribution  in  the 
form  of  two  graphs  that  are  created  by  supplying  a  type  argument  to  the 
plot  function: 

>  plot(  dwt .linchirp,  type="energy"  ) 

The  result  (Fig.  3.3)  is  a  bar  plot  showing  the  energy  in  each  crystal  and 
a  pie  chart  depicting  the  proportion  of  the  total  energy  trapped  by  each 
crystal. 

The  summary  method  also  gives  us  a  look  at  how  the  energy  is  distributed 
across  all  the  DWT  coefficients,  i.e.,  outside  of  their  classification  within 
particular  crystals.  An  examination  of  the  last  part  of  the  summary  above 
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DWT  Energy  of  llnchirp  Energy  Distribution 


d1  62  d3  64  s4 


FIGURE  3.3.  Energy  distribution  of  linear  chirp  DWT. 
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shows  that  the  coefficient  with  the  largest  magnitude  (4.028)  accounts  for 
3.2%  of  the  energy  in  the  time  series.  We  also  see  that  15%  of  the  coefficients 
contain  96.2%  of  the  energy  and  that  the  magnitudes  of  these  coefficients 
are  bounded  below  by  0.637  (there  are  154  coefficients  with  magnitudes 
greater  than  or  equal  to  this  number).  A  summary  such  as  this  is  helpful 
in  determining  how  well  the  DWT  succinctly  captures  the  salient  features 
in  a  time  series 

3,L2  The  DWT  in  the  time  domain 

The  DWT  can  be  calculated  by  processing  the  data  using  a  filter  cascade, 
where  a  wavelet  filter  {hi}  and  its  associated  scaling  filter  {gi}  are  used  in 
a  ‘pyramid’  algorithm  to  decompose  the  time  series.  To  generate  the  first 
level  of  coefficients,  the  original  data  is  filtered  by  convolving  it  separately 
with  the  wavelet  and  scaling  filters.  Both  filter  outputs  are  then  decimated 
by  a  factor  of  two  (i.e.,  every  other  point  is  thrown  out),  and  the  remaining 
filter  outputs  are  defined  as  the  unit  level  {j  =  1)  wavelet  and  scaling 
coefficients.  For  the  second  level  (j  =  2),  the  same  filtering/decimation 
scheme  is  applied,  but  now  the  unit  level  scaling  coefficients  are  used  as 
the  input  to  the  filters.  This  algorithm  can  be  repeated  to  obtain  higher 
level  coefficients.  Thus,  at  the  jih  level,  the  inputs  to  the  wavelet  and 
scaling  filters  are  the  scaling  coefficients  from  the  previous  level  {j  —  1), 
and  the  outputs  are  the  jth  level  wavelet  and  scaling  coefficients. 

Mathematically  we  can  describe  the  DWT  as  follows.  Let  be  a 

uniformly  sampled  real- valued  time  series  consisting  of  N  observations,  the 
tih  of  which  is  denoted  by  Xt  (by  uniformily  sampled,  we  mean  that  the 
time  at  which  we  collected  the  tih  observation  can  be  expressed  as  to -ht  At, 
where  to  is  the  time  at  which  we  observed  Xq,  and  At  >  0  is  the  sampling 
time  between  observations).  Define  So,t  =  Xt  to  be  the  zeroth  level  scaling 
coefficients.  Starting  with  level  j  =  I  and  recursively  continuing  on  for 
levels  j  =  2, . . . ,  J,  we  can  calculate  the  DWT  wavelet  coefficients  via 

L-l 

^  ^  ^  hlSj^l ^21-^1— l  mod  Nj-i  J  ^  =  0, .  .  .  ,  Nj  —  1, 

1=0 

and  the  DWT  scaling  coefficients  via 
L-l 

Sj^t  =  ^  mod  Nj^i,  t  =  0,,  .  .  ,Nj  —I, 

1=0 

where  Nj  =  [N/2^  (here  [x\  refers  to  the  largest  integer  that  is  less  than 
or  equal  to  a:).  Here  are  four  comments  about  the  above  two  equations. 

1.  We  are  using  ‘modulo’  arithmetic  to  specify  which  scaling  coeffi¬ 
cients  are  to  be  used  in  forming  the  above  summations.  Thus,  if 
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0<2t-hl“l<  iVj-i  -  1,  the  expression  +  1  -  /  mod 
is  taken  to  be  equal  to  2t  +  1  -  1;  if  this  condition  is  not  true,  then 
the  expression  is  taken  to  be  2^  +  1  —  1  +  nNj_i,  where  nNj-i  is  the 
unique  integer  multiple  of  Nj-i  such  that  0<2t  +  l“lH-  nNj^i  < 
Nj-i  -  1.  For  indices  t  such  that  2i  +  1  -  i  mod  N^-x  is  not  the 
same  integer  as  2^  H-  1  —  the  values  of  dj^t  sj^t  formed 
by  combining  together  some  values  from  the  beginning  of  the  se¬ 
quence  of  scaling  coefficients  *  •  •)  with  some  values  from  the 

end  In  effect,  we  are  treating  the  scaling  coeffi¬ 

cients  as  if  they  were  ‘circular’  for  the  purposes  of  creating  the  filter 
outputs;  i.e.,  we  replace  the  unavailable  values  . . . , 
with  We  use  the  terminology  ‘bound¬ 

ary  coefficient’  to  refer  to  any  coefficient  whose  computation  involves 
the  circularity  assumption  in  some  manner.  Because  the  physical  in¬ 
terpretation  of  boundary  coefficients  can  be  problematic,  there  are 
special  tools  and  displays  in  S 4- Wavelets  that  allow  us  to  access  and 
delineate  these  coefficients.  Coefficients  that  are  not  boundary  co¬ 
efficients  are  deemed  to  be  ‘interior’  coefficients  (or  ‘nonboundary’ 
coefficients), 

2.  In  our  description  of  the  pyramid  algorithm  above,  we  noted  that  the 
jth  wavelet  (scaling,  respectively)  coefficients  are  formed  by  filtering 
the  scaling  coefficients  from  level  j  —  1  with  the  wavelet  (scaling)  filter, 
after  which  we  then  decimate  the  filter  outputs  by  a  factor  two.  In 
the  above  equations,  this  decimation  is  accomplished  by  use  of  ‘2t’  in 
the  indices  to  the  input  scaling  coefficients. 

3.  The  maximum  level  J  that  we  can  use  is  given  by  [1^62 When 
J  is  set  to  this  level,  there  will  be  exactly  one  wavelet  and  one  scaling 
coefficient  (dj,o  ^'iid  sj^q).  If  the  sample  size  N  is  equal  to  2^^,  then 
sj^o  is  proportional  to  the  sample  mean  of  the  time  series  (for  details, 
see  Exercise  [97]  of  Percival  and  Walden,  2000). 

4.  To  maintain  backward  compatibility  with  version  1.0  of  S+Wavelets, 
we  are  using  dj^t  ^i^d  sj^t  to  denote  ^th  level  wavelet  and  scaling 
coeffients.  This  notation  differs  from  what  is  used  in  Percival  and 
Walden  (2000),  where  these  coefficients  are  denoted  by  Wj^t  and 

3.1.3  The  DWT  in  the  frequency  domain 

While  the  pyramid  algorithm  allows  us  to  compute  the  DWT  efficiently,  we 
could  in  principle  also  obtain  the  wavelet  coefficients  for  a  given  level  j  by 
using  a  single  filter,  which  we  call  the  jth  level  wavelet  filter;  likewise,  we 
can  obtain  the  jth  level  scaling  coefficients  by  using  the  jth  level  scaling 
filter.  Examination  of  the  frequency  domain  properties  of  these  jih  level 
filters  leads  to  an  interpretation  of  the  DWT  as  an  ‘octave  band’  filter  bank. 


18 


3.  Wavelet  Transforms 


The  DWT  can  be  calculated  by  processing  the  data  using  a  filter  bank^ 
where  the  wavelet  and  scaling  filters  are  used  in  a  recursive  (pyramid) 
algorithm  to  decompose  the  time  series.  To  generate  the  first  level  transform 
coefficients,  the  original  data  is  filtered  by  convolving  it  with  both  the 
wavelet  and  scaling  filters  (§2),  The  results  are  then  decimated  by  a  factor 
of  two,  where  every  other  point  is  thrown  out,  and  the  remaining  coefficients 
are  defined  as  the  level-one  wavelet  and  scaling  coefficients.  For  the  second 
level,  the  same  filtering-decimation  scheme  is  applied  (only)  to  the  scaling 
coefficients.  This  algorithm  can  be  repeated  for  higher  decomposition  levels 
until  the  number  of  wavelet  and  scaling  coefficients  is  unity  (and  cannot  be 
broken  down  any  further). 

We  can  replicate  this  approach  by  processing  the  original  data  with  a  set 
of  scaled  (amplitude  reduced)  and  dilated  (time  stretched)  versions  of  the 
wavelet  and  scaling  filters,  one  filter  set  per  level  of  the  transform.  The  ad¬ 
vantage  in  this  approach  is  that  the  gain  functions  (frequency  responses)  of 
the  resulting  filter  sets  clearly  show  the  bandpass  nature  of  the  filter  bank. 
To  illustrate  this  point,  use  the  wavGain  function  to  obtain  the  frequency 
response  of  the  level  j  Daubechies  8-tap  least  asymmetric  filters  wavelet 
filter  and  scaling  filter  (Gj(/))  for  j  =  1, , . . ,  5: 

>  gain  <-  wavGainC  "s8",  n. level  =  5  ) 

>  gain 

Gain  functions  for  s8  filters 

Number  of  levels :  5 

Number  of  Fourier  frequencies:  1024 

Filters  normalized:  TRUE 

The  result  is  an  object  of  class  WaveletGain.  You  can  plot  the  squared  gain 
functions  by  invoking  the  plot  method: 

>  plot(  gain  ) 

Figure  3.4  shows  the  result.  The  vertical  lines  in  these  plots  define  the 
octaves  over  which  the  wavelet  filters  are  associated:  the  wavelet  filter  for 
level  j  is  associated  with  an  approximate  bandpass  filter  whose  passband 
frequencies  are  /  €  [l/2^'+^  1/2^'].  Similarly,  the  scaling  coefficients  filter  at 
level  j  is  associated  with  an  approximate  bandpass  filter  whose  passband 
frequencies  are  /  G  [0, 1/2^"^^]. 

Using  these  scaled  and  dilated  filter  sets,  we  can  calculate  the  DWT 
wavelet  coefficients  at  level  j  via 
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where  I  K{  •)  is  the  downsample  operator  (every  point  is  kept), 
•  )  is  the  inverse  discrete  Fourier  transform  operator,  X{f)  is  the 
frequency  response  of  the  the  original  time  series 

for  =  0, . . . ,  N  -  1.  Similarly,  the  DWT  scaling  coefficients  at  level  j  can 
be  calculated  using 

Si=i2HT-HGj{f)Xim. 


0.0  0,2  0.4  0.6  0.8  1,0 

Normalized  Frequency  (f) 


Normalized  Scaling  Filter  ( s8  ) 


FIGURE  3.4.  Squared  gain  functions  of  Daubechies, least  asymmetric  8-tap  filters 
for  levels  j  =  1, . . . ,  5. 


3.1.4  Interpretation  of  DWT  coefficients 

As  noted  in  §2,  the  wavelet  coefficients  are  proportional  to  differences  be¬ 
tween  local  averages  of  the  data  taken  on  a  scale  proportional  to  the  effec¬ 
tive  filter  width.  The  wavelet  (and  scaling)  filter  is  scaled  at  each  level  j  of 
the  wavelet  transform  such  that  its  effective  scale  is 

T,  =2J-*At 

where  At  is  the  sampling  interval  of  Xt  (assumed  from  this  point  forward 
to  be  unity  unless  specified  otherwise).  Similarly,  the  scaling  coefficients 
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at  level  j  are  proportional  to  the  local  average  of  the  data  taken  at  scale 
Tj.  Using  these  dual  interpretations,  the  wavelet  transform  allows  us  to 
explore  the  variability  at  different  scales  of  the  data,  a  sort  of  variably- 
sized  mathematical  microscope. 

Each  wavelet  and  scaling  coefficient  is  typically  also  localized  in  time; 
i.e.,  except  at  the  very  largest  scales,  each  coefficient  is  formed  using  a 
limited  portion  of  the  time  series.  By  studying  the  phase  functions  that 
are  associated  with  the  jth  level  equivalent  filters  and  {gj,i},  it  is 

possible  to  associate  a  time  with  each  coefficient.  This  association  makes 
most  sense  when  filters  have  what  is  known  in  the  engineering  literature  as 
linear  phase.  Within  the  class  of  filters  that  yield  an  orthonornal  DWT,  it 
is  not  possible  to  have  filters  with  exact  linear  phase,  but,  by  construction, 
the  symmlet  and  coiflet  filters  are  approximately  linear  phase  filters.  If 
approximate  linear  phase  filters  are  used  in  the  DWT,  then  the  transform 
coefficients  can  be  shifted  (circularly  permuted)  so  that  they  align  with 
events  in  the  original  time  series;  i.e.,  they  are  shifted  for  approximate 
zero  phase.  To  do  so,  you  can  use  the  wavShift  function  as  in  the  following 
example: 

>  wavShift (  dwt.linchirp  ) 

Discrete  Wavelet  Transform  of  linchirp 
Wavelet:  s8 

Length  of  series:  1024 
Number  of  levels:  4 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Shifted  for  approximate  zero  phase:  TRUE 
Crystals :  dl  d2  d3  d4  s4 

The  function  wavShift  returns  an  update  version  of  dwt.linchirp  containing 
cystals  that  have  been  shifted  so  that  they  can  be  matched  up  in  time  with 
events  in  the  original  time  series.  This  fact  is  reflected  in  the  next  to  last 
line  above,  where  it  is  noted  that  the  crystals  have  been  shifted  to  achieve 
approximate  zero  phase.  To  see  the  shifts,  you  can  use  the  plot  method  on 
the  object  created  by  wavShift: 

>  plot(  wavShift (dwt.linchirp)  ) 

Figure  3.5  shows  the  result.  The  shift  used  for  each  crystal  appears  next  to 
each  crystal  name.  A  negative  shift  implies  an  advance  (or  circular  shift  to 
the  left)  of  the  data. 

If  approximate  linear  phase  filters  are  used  in  the  DWT,  then  the  trans¬ 
form  coefficients  can  be  shifted  (circularly  permuted)  so  that  they  align 
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DWT  of  linchirp  using  s8  filters 
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FIGURE  3.5.  The  DWT  of  the  linchirp  sequence  circularly  shifted  for  approxi¬ 
mate  zero  phase. 
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with  events  in  the  original  time  series,  i.e.  they  are  shifted  for  approximate 
zero  phase.  The  shift  factors  for  Daubechies  coiflet  or  least  asymmetric 
(symmlet)  families  may  be  calculated  via  the  wavZeroPhase  function. 

>  wavZeroPhasef  wavelet  =  "s8",  levels  =  1:4  ) 

$dwt : 

dl  d2  d3  d4  si  s2  s3  s4 

-2  -2  -3  -3  -1  -2  -2  -2 

$modwt : 

dl  d2  d3  d4  si  s2  s3  s4 

-4  -11  -25  -53  -3  -9  -21  -45 

$dwpt : 

wl.O  wl.l  w2.0  w2.1  w2.2  w2.3  w3.0  w3.1  w3.2  w3.3  u3.4 

-1  -2  -2  -2  -3  -2  -2  -3  -3  -2  -3 

w3.5  w3.6  w3.7  w4.0  w4.1  w4.2  w4.3  w4.4  w4.5  w4.6  w4.7 

-3  -3  -2  -2  -3  -3  -3  -3  -3  -3  -2 

w4.8  w4.9  w4.10  w4.11  w4.12  w4.13  w4.14  w4.15 

-3  -3  -3  -3  -3  -3  -3  -2 

$modwpt : 

wl.O  wl.l  w2.0  w2.1  w2.2  w2.3  w3.0  w3.1  w3.2  w3.3  w3.4 

-3  -4  -9  -11  -12  -10  -21  -25  -27  -23  -24 

w3.5  w3.6  w3.7  w4.0  w4.1  w4.2  w4.3  w4.4  w4.5  w4.6  w4.7 

-28  -26  -22  -45  -53  -57  -49  -51  -59  -55  -47 

w4.8  w4.9  w4.10  w4.11  w4.12  w4.13  w4.14  w4.15 

-48  -56  -60  -52  -50  -58  -54  -46 

The  wavZeroPhase  function  returns  the  shifts  for  the  DWT  as  well  as  other 
transforms.  You  could  use  these  shift  factors  to  manually  rotate  each  crys¬ 
tal  appropriately,  but  a  more  convenient  means  is  through  the  wavShift 
function. 
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>  wavShiftC  dwt. chirp  ) 

Discrete  Wavelet  Transform  of  linchirp 
Wavelet:  s8 

Length  of  series:  2048 
Number  of  levels:  4 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Shifted  for  approximate  zero  phase:  TRUE 
Crystals:  dl  d2  d3  d4  s4 

Notice  that  the  display  method  now  indicates  that  the  crystals  have  been 
shifted  for  zero  phase.  To  see  the  shifts,  use  the  plot  method  as  usual: 

>  plot(  wavShift (dwt , chirp)  ) 

Figure  3.5  shows  the  result.  The  shift  used  for  each  crystal  appears  next  to 
each  crystal  name.  A  negative  shift  implies  an  advance  (or  circular  shift  to 
the  left)  of  the  data. 

3.L5  The  WaveletTransform  object 

The  wavDWT  function  calculates  the  DWT  of  a  real-valued  uniformly- 
sampled  time  series  and  returns  an  object  of  class  WaveletTransform.  Several 
methods  are  available  to  the  user  to  view,  summarize,  and  access  the  data 
contained  in  a  WaveletTransform  object: 

Summary  Operator  Methods: 


print  Prints  useful  information  regarding  the  wavelet  trans¬ 

form  including: 

•  Type  of  wavelet  transform. 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  Whether  or  not  the  transform  coefficients  have 
been  shifted  for  zero  phase  (only  suitable  for  coiflet 
and  symmlet  filters). 

•  The  crystal  names. 
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plot 


eda.plot 


summary 


Plots  the  transform  coefficients.  If  the  transform  is 
shifted  for  zero  phase,  the  shift  factor  appears  adjacent 
to  the  crystal  name.  Use  the  string  “energy"  as  a  value 
for  the  optional  type  argument  to  display  an  energy 
distribution  plot  of  the  crystals. 

Extendend  data  analysis  plot  displaying  the  trans¬ 
form,  crystal  energy  distribution,  and  coefficient  dis¬ 
tribution 

Displays  a  statistical  summary  of  the  transform  data. 


Transform  Operator  Methods 


mrd 

mra 

reconstruct 


Perform  a  multiresolution  decomposition  of  the  data. 
Perform  a  multiresolution  analysis  of  the  data. 
Reconstructs  the  time  series  via  an  inverse  transform. 


wavShift  Circularly  shift  each  crystal  to  achieve  approximate 

zero  phase,  (only  suitable  for  coiflet  and  symmlet  fil¬ 
ters). 

wavDetail  Calculate  the  detail  coefficients  for  specified  crystals. 


Data  Access  Methods 


Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet- 
Transform  object.  For  example,  to  obtain  the  first  and 
second  level  wavelet  crystals  of  a  MODWT  or  DWT 
object  X,  use  either  X[l:2]  or  X[c("dl",“d2")].  While 
the  former  is  more  compact,  the  latter  is  preferred  be¬ 
cause  of  it  leaves  no  doubt  as  to  which  crystals  are 
to  be  extracted  and  does  not  rely  on  any  particular 
ordering  of  the  crystals  in  the  object. 

Access  an  individual  crystal  of  a  WaveletTransform  ob¬ 
ject.  For  example,  to  obtain  the  second  level  wavelet 
crystal  of  a  MODWT  or  DWT  object  X,  use  either 
X[[2]]  or  X[["d2’']].  The  result  is  a  vector  of  transform 
coefficients.  If  however  multiple  crystals  are  requested 
(ala  X[[c("dl".“d2")]]  for  example),  the  result  is  an 
S-PLUS  list  containing  the  requested  crystals. 
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$  Use  to  access  specific  components  of  the  WaveletTrans- 

form  object.  A  list  of  accessible  components  can  be 
generated  using  the  names  function.  One  such  com¬ 
ponent  is  data  which  contains  an  S-PLUS  list  of  all 
wavelet  transform  crystals.  This  gives  the  user  yet  an¬ 
other  way  to  access  specific  transform  crystal(s).  For 
example,  if  X  is  an  object  of  class  WaveletTransform, 
the  d2  crystal  can  be  accessed  via  X$data$d2. 


3.2  The  Maximal  Overlap  Discrete  Wavelet 
Transform 

Despite  its  popularity,  the  DWT  has  two  practical  limitations.  The  first 
is  the  dyadic  length  requirement.  While  the  DWT  can  be  adapted  to  ac¬ 
commodate  arbitrary  length  sequences  via,  e.g.,  polynomial  extensions  of 
the  scaling  coefficients,  selecting  an  appropriate  number  of  end  points  to 
fit  or  the  order  of  fit  is  not  a  trivial  task.  Other  techniques  can  be  used, 
such  as  the  odd-scaling  coefficient  storage  system  used  for  the  wavDWT 
function,  but  generally  involve  either  complicated  bookkeeping  or  are  too 
simple  to  accurately  portray  the  dynamics  of  the  scaling  coefficients.  The 
second  limitation  is  a  sensitivity  of  the  DWT  to  where  we  start  recording 
a  time  series;  i.e.,  the  decimation  operation  makes  the  DWT  a  non  shift- 
invariant  transform  so  that  circularly  shifting  the  time  series  can  alter  the 
entire  DWT. 

To  overcome  these  limitations,  we  can  use  a  non-decimated  form  of  the 
DWT,  known  as  the  maximal  overlap  DWT  (MODWT),  that  has  two  main 
advantages:  (1)  it  handles  arbitrary  length  sequences  inherently  and  (2)  cir¬ 
cularly  shifting  the  time  series  will  result  in  an  equivalent  circular  shift  of 
the  MODWT  coefficients.  Additionally,  the  number  of  coefficients  in  each 
scale  is  equal  to  the  number  of  points  in  the  original  time  series.  This  refined 
slicing  of  the  data  in  combination  with  the  approximate  zero  phase  prop¬ 
erty  of  the  least  asymmetric  filters  allows  us  to  calculate  ‘instantaneous’ 
statistical  measures  of  the  data  across  scales  (e.g.  instantaneous  fractionally 
differenced  process  model  parameters,  see  §5  for  details). 

3.2.1  Definition 

Let  Xt,  i  =  0, 1, . . . ,  iV  -  1,  represent  a  real- valued  uniformly-sampled  time 
series,  and  let  hi  and  p/,  I  =  0,1,...,L  —  1,  be  the  coefficients  for,  respec¬ 
tively,  the  wavelet  and  scaling  filters  of  width  L  used  by  the  DWT.  To 
preserve  energy  in  the  MODWT,  we  need  to  use  rescaled  versions  of  these 
filters,  which  we  define  as  follows: 

hi  =  and  gi  =  9i/\/2. 
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In  order  to  define  the  MODWT  for  a  given  decomposition  level  j,  we  start 
by  defining  the  MODWT  scaling  coefficient  at  level  ^  =  0  and  time 
index  t  to  be  equal  to  the  value  of  the  time  series  at  index  t]  i.e.,  So,<  =  Xt^ 
t  =  -  1.  The  MODWT  wavelet  coefficients  dj^t  and  scaling 

coefficients  sj^t  for  level  j  are  defined  recursively  in  terms  of  the  scaling 
coefficients  for  level  j  —  1  as  follows: 

L-l 

dj^t  =  ^  ^  I  mod  N 

1=0 
L-l 

^  I  mod  Ni 

1=0 

where  i  =  0, 1, . . . ,  AT  —  1. 

While  the  above  is  an  efficient  way  of  computing  the  MODWT  wavelet 
and  scaling  coefficients,  it  is  also  possible  to  obtain  them  directly  from  the 
time  series  via  the  equations 


where  hj^i  and  Pj,/,  /  =  -  1,  are  called  the  level  j  equivalent 

MODWT  wavelet  and  scaling  filters.  Both  of  these  filters  have  a  width 
given  by  Lj  =  (2^  —  1)(Z/  —  1)  +  1.  When  j  =  Ij  we  have  Li  =  L,  hi^i  =  hi 
and  gi^i  =  p/.  These  equivalent  filters  are  mainly  of  interest  for  theoretical 
developments  and  can  be  formulated  using  just  the  basic  filters  hi  and  gi 
(for  details,  see  Section  5.4  of  Percival  and  Walden,  2000). 


Lj-l  ^ 

=  ^  ^  hj^lXi^l  mod  N 

1=0 
Lj-1 

~  ^  V  9jjXt— I  mod  Ni 

1=0 


3.2,2  An  example:  the  MODWT  of  a  linear  chirp 

To  calculate  a  MODWT,  use  the  wavMODWT  function  which,  like  the 
wavDWT  function,  returns  an  object  of  class  WaveletTransform.  Here  we 
calculate  a  level  4  MODWT  of  the  linchirp  sequence  using  Daubechies  12- 
tap  Coiflet  filters: 
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>  modwt . chirp  <-  wavMODWK  linchirp,  wavelet  =  "cl2", 

+  n. levels  =  4  ) 

>  modwt. chirp 

Maximal  Overlap  Discrete  Wavelet  Transform  of  linchirp 

Wavelet:  cl2 

Length  of  series:  1024 

Number  of  levels:  4 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Shifted  for  approximate  zero  phase:  FALSE 

Crystals:  dl  d2  d3  d4  s4 

>  plot(  wavShift (modwt . chirp)  ) 

Figure  3.6  shows  the  result  shifted  for  zero-phase.  A  comparison  of  the 
Fig.  3.5  and  3.6  shows  that  the  (non-decimated)  MODWT  is  visually 
smoother  than  the  (decimated)  DWT.  Unlike  the  DWT,  the  MODWT 

MODWT  of  linchirp  using  c1 2  filters 


d1{-6} 


d2{-17} 


d3{-39} 


FIGURE  3.6.  Maximal  overlap  discrete  wavelet  transform  of  a  linear  chirp  shifted 
for  zero  phase. 
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is  non-orthogonal  and  highly  redundant.  Like  the  DWT,  the  MODWT  is 
energy  preserving.  We  can  demonstrate  this  by  taking  the  difference  be¬ 
tween  the  energy  of  the  original  time  series  and  the  MODWT: 

>  sum(  linchirp''2  )  -  sum(  unlist (modwt .  chirp$data)  "2  ) 

[1]  -2.807042e-09 

We  can  also  test  the  reconstruct  function  in  a  similar  manner: 

>  vecnormC  reconstruct  modwt . chirp)  -  linchirp  ) 

[1]  3.565704e~10 

The  difference  in  reconstruction  is  very  small  and  is  due  to  roundoff  error 
in  the  computation.  We  can  use  the  reconstruction  method  for  more  inter¬ 
esting  experiments  such  as  synthesizing  the  MODWT  after  zeroing  out  the 
d2  and  d4  crystals: 

>  modwt. chirp[c("d2","d4")]  <”  0 

>  recon  <-  reconstruct (  modwt. chirp  ) 

>  example  <-  list(  linchirp=linchirp,  synth=recon, 

+  diff=linchirp~recon  ) 

>  stack. plot (  example  ) 

The  effect  is  to  remove  the  high-frequency  and  mid-frequency  components 
of  the  chirp  (Fig.  3.7). 


3.3  The  Discrete  Wavelet  Packet  Transform 

3.3.1  Overview 

As  we  discussed  in  §3.1.2,  the  wavelet  and  scaling  filters  are  used  to  create 
the  DWT.  This  transform  essentially  takes  a  time  series  consisting  of  N 
values  and  reexpresses  it  in  the  time-scale  domain  in  terms  of  N  DWT 
coefficients.  There  are  two  types  of  DWT  coefficients,  namely,  wavelet  co¬ 
efficients  (encapsulating  information  about  changes  in  weighted  averages 
at  different  scales)  and  scaling  coefficients  (related  to  weighted  averages). 
These  filters  are  used  in  tandem  in  the  pyramid  algorithm.  Thus,  letting 
j  =  1, . . . ,  J  and  starting  with  the  definition  that  the  zeroth  level  scaling 
coefficients  are  given  by  the  time  series  itself,  we  take  the  level  j  —  1  scal¬ 
ing  coefficients  and  transforms  them  into  wavelet  and  scaling  coefficients 
of  level  j  using,  respectively,  the  wavelet  and  scaling  coefficients.  After  J 
iterations  of  the  pyramid  algorithm,  the  DWT  consists  of  J  H-  1  crystals 
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0.0 


0.2 


0.4 


0.6 


0.8 


1,0 


FIGURE  3.7.  A  denoising  example.  The  top  plot  is  the  original  linchirp  sequence. 
The  middle  plot  is  the  reconstruction  of  the  MODWT  of  the  linchirp  sequence 
with  the  dl  and  d3  crystals  zeroed  out.  The  final  plot  is  the  difference  between 
the  synthesis  and  the  original  sequence. 
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(components),  namely,  the  wavelet  coefficients  from  levels  j  =  1, . . . ,  J  and 
the  scaling  coefficients  from  level  J. 

In  this  scheme,  once  the  wavelet  coefficients  are  created,  we  leave  them 
alone  and  do  not  subject  them  to  any  further  transformations.  If,  however, 
we  decide  to  treat  the  level  j  wavelet  coefficients  in  a  manner  analogous 
to  scaling  coefficients,  we  can  obtain  what  is  know  as  a  discrete  wavelet 
packet  transform  (DWPT).  A  level  j  DWPT  consists  of  2^  crystals,  each  of 
which  contains  iV/2^  values,  where  N  is  the  sample  size  of  the  time  series 
(for  the  purposes  of  this  discussion,  we  assume  that  iV  is  a  power  of  two, 
but  in  fact  the  DWPT  in  S+ Wavelets  can  handle  arbitrary  sample  sizes). 

As  a  simple  example,  let  us  return  to  the  linear  chirp  we  created  and 
stored  in  linchirp  (Fig.  3.1). 


3.3,2  The  DWPT  in  the  time  domain 


Level  0 
Level  1 
Level  2 
Level  3 

FIGURE  3.8.  Wavelet  packet  table  with  3  decomposition  levels 

The  algorithm  that  dictates  how  we  go  from  level  j  to  level  j  +  1  says  that 
we  take  each  crystal  and  subject  its  contents  to  both  a  wavelet  filter  and 
a  scaling  filter,  yielding  two  new  crystals  that  form  part  of  the  level  i  +  1 
DWPT, 

We  can  illustrate  the  DWPT  algorithm  with  the  help  of  Fig.  3.8,  which 
shows  the  creation  of  DWPTs  of  levels  1,  2  and  3. 

3.3.3  The  DWPT  in  the  frequency  domain 

3.3.4  The  WaveletPacket  Object 

The  wavDWPT  and  wavMODWPT  functions  calculate  the  DWPT  and  MOD- 
WPT,  repsectively,  of  a  real- valued  uniformly-sampled  time  series  and  re¬ 
turns  an  object  of  class  WaveletPacket.  Methods  are  available  to  the  user 
to  view  and  summarize  the  data  contained  in  a  WaveletPacket  object: 

Summary  Operator  Methods: 

display  Prints  useful  information  regarding  the  wavelet  packet 

transform  including: 

•  Type  of  wavelet  packet  transform. 


wO.O 

wl.O 

w] 

■1 

w2.0 

w2.2 

w2.3 

;  w3.0 "  w3.1 " 

w3.2  w3.3 

w3.4  w3.5 

w3.6  w3.7 
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•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names. 

plot  Plots  the  transform  coefficients. 

Transform  Operator  Methods 


mrd 

mra 

reconstruct 


Perform  a  multiresolution  decomposition  of  the  data. 
Perform  a  multiresolution  analysis  of  the  data. 
Reconstructs  the  time  series  via  an  inverse  transform. 


wavShift  Circularly  shift  each  crystal  to  achieve  approximate 

zero  phase,  (only  suitable  for  coiflet  and  symmlet  fil¬ 
ters). 

wavDetail  Calculate  the  detail  coefficients  for  specified  crystals. 


Data  Access  Methods 


Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet- 
Packet  object.  For  example,  to  obtain  the  first  and  sec¬ 
ond  level  wavelet  crystals  of  a  MODWPT  or  DWPT 
object  X,  use  X[level  =  1:2].  Individual  crystals  may 
be  accessed  as  we  using  the  crystal  name(s)  as  an  in¬ 
put  ala  X[c(‘‘wl.0”,“w3.1")]  for  example.  In  all  cases, 
the  original  WaveletPacket  object  is  returned  with  a 
subset  of  the  original  crystals. 

Access  an  individual  crystal  of  a  WaveletPacket  ob¬ 
ject.  For  example,  to  obtain  the  node  correpsonding 
to  level  2  and  oscillation  index  3  of  a  WaveletPacket 
object  X,  use  X[["w3.2”]].  The  result  is  a  vector  of 
transform  coefficients.  If  however  multiple  crystals  are 
requested  (ala  X[[c("w3.0” ,  “wl.l")]]  for  example),  the 
result  is  an  S-PLUS  list  containing  the  requested  crys¬ 
tals.  In  all  cases,  only  the  specified  transform  coeffi¬ 
cients  are  returned,  i.e.  all  other  components  of  the 
original  WaveletPacket  object  are  excluded. 
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$  Use  to  access  specific  components  of  the  WaveletPacket 

object.  A  list  of  accessible  components  can  be  gener¬ 
ated  using  the  names  function.  One  such  component 
is  data  which  contains  an  S-PLUS  list  of  all  wavelet 
transform  c^yst^ds.  This  gives  the  user  yet  another  way 
to  access  specific  transform  crystal(s).  For  example,  if 
X  is  an  object  of  class  WaveletPacket,  the  w3.0  crystal 
can  be  accessed  via  X$data$w3.0. 


3.4  The  Maximal  Overlap  Wavelet  Packet 
Transform 

The  MODWT  discussed  in  §3.2  can  be  easily  extended  to  the  maximal  over¬ 
lap  discrete  wavelet  packet  transform  (MODWPT).  The  MODWPT  is  seen 
as  a  collection  of  non-orthogonal  transforms.  Each  level  of  the  transform  is 
associated  with  a  level  j,  where  the  level  MODWPT  decomposes  the  fre¬ 
quency  interval  [0, 1/2]  into  2-^  uniform  divisions.  Similar  to  the  Short-Time 
Fourier  Transform,  the  MODWPT  is  seen  as  a  time-frequency  decomposi¬ 
tion  because  it  decomposes  a  time  series  into  crystals  such  that  each  crystal 
is  associated  with  a  particular  range  of  frequencies  and  each  coefficient  of 
a  crystal  corresponds  to  to  a  particular  time. 


3.4- i  Definition 

Given  j,  n,  t  are  the  decomposition  level,  local  node  index,  and  time  index, 
respectively,  the  MODWPT  is  given  by 


_  L-l 

Wj^n,t  =  I  mod  N 

/=0 


The  variable  L  is  the  length  of  the  filters  defined  by 

Un^i  =  gi  /  v^2  if  n  mod  4  ==  0  or  3 

=  hi /y/2  if  n  mod  4  =  1  or  2  for  /  =  0, . . . ,  L  —  1 

where  gi  and  hi  are  the  scaling  filter  and  wavelet  filter,  respectively.  By 
definition,  Wo,o,t  =  where  {Xt}  is  the  original  time  series. 
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3.4.2  An  example:  MODWPT  of  a  linear  chirp 

>  modwpt . chirp  <-  wavMODWPT(  linchirp,  wavelet  =  "s8", 

+  n. levels  =  3  ) 

>  modwpt. chirp 

Maximal  Overlap  Discrete  Wavelet  Packet  Transform  of  linchirp 
Wavelet :  s8 

Length  of  series:  1024 

Number  of  levels:  3 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Shifted  for  approximate  zero  phase:  FALSE 

Crystals : 


"wO. 

.0" 

"wl.O" 

"wl.l" 

’'w2. 

.0" 

•'w2.1" 

"w2.2’' 

’'w2. 

.3" 

"w3.0" 

"w3.1’' 

"w3. 

.2" 

"w3.3” 

’•w3.4" 

(15 

bases) 

plot( 

modwpt 

.chirp  ) 

The  crystals  are  order  ala  vjj.n  where  j  is  the  decomposition  level  and 
n  is  the  node  index  for  n  =  0, . . . ,  2-^  —  1.  A  crystal  wj.n  corresponds  to 
the  normalized  frequency  range  [n/2^■+^  (n  +  l)/2^’+^].  For  example,  crystal 
w3.2  corresponds  to  the  frequency  interval  [1/8, 3/16].  Figure  3.9  shows  the 
MODWPT  of  the  linear  chirp  out  to  three  levels. 


3.5  Multiresolution  Decomposition  and  Analysis 

Multiresolution  decomposition  (MRD)  involves  breaking  down  a  time  se¬ 
ries  or  image  into  its  fundamental  components.  Each  component  contains 
information  related  to  the  variations  in  the  original  data  at  a  certain  scale. 
Summing  all  of  the  components  together  will  give  you  the  original  data. 
The  process  of  successively  summing  the  data  based  on  its  MRD  is  known 
as  multiresolution  analysis  (MRA).  Summing  only  a  few  of  the  components 
removes  those  portions  deemed  undesirable  in  the  data  and  can  be  used  as 
a  very  eflfective  ‘denoising’  tool.  Consider,  for  example,  the  following  MRD 
of  an  electrocardiogram  signal  using  the  MODWT: 
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Level  0 


Level  1 


Level  2 


Level  3 


1.1 


-1.1 


FIGURE  3.9.  Mzocimal  overlap  discrete  wavelet  packet  transform  of  a  linear  chirp. 
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>  modwt.ecg  <-  wavM0DWT(  ecg,  wavelet  =  *’s8",  n. levels  =  6  ) 

>  mrd.ecg  <-  mrdC  modwt.ecg  ) 

>  mrd.ecg 

MsLximal  Overlap  Wavelet  Decomposition  of  modwt.ecg 
Wavelet :  s8 

Length  of  series:  2048 
Number  of  levels:  6 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Signal  Components:  D1  D2  D3  D4  D5  D6  S6 

>  plot(  mrd.ecg  ) 


sum 

D1 

D2 

D3 

D4 

D5 

D6 

S6 


+ 


H - 4 - k — * - k - k * - * - » - * - 1 - < - ♦ - ^ 

— k — k — k — ^ ^ ^ 


500 


1000 


1500 


2000 


FIGURE  3.10.  MODWT  multiresolution  decomposition  of  an  ECG  sequence. 

Figure  3.10  shows  the  resulting  MRD  of  the  ecg  sequence  out  to  six  de¬ 
composition  levels.  We  see  that  the  baseline  drift  (due  to  respiration)  is 
captured  mainly  in  the  S6  crystal  while  a  small  amount  of  noise  is  seen  in 
the  first  portion  of  the  D1  crystal.  Suppose  we  wish  to  get  rid  of  the  small 
scale  (high  frequency)  noise  that  exists  in  the  D1  component  and  to  exclude 
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the  low  frequency  base-line  drift  due  to  respiration  captured  in  component 
S6.  To  do  so,  we  simply  sum  components  D2-D6: 

>  nobaseline  <~  apply (  mrd. ecg[2 : 6,] ,  MARGIN=1,  sum  ) 

>  comparison  <-  list(  ecg=ecg,  detrend=nobaseline  ) 

>  stack. plot (  comparison  ) 

Figure  3.11  shows  a  comparison  of  the  “denoised”  and  original  ecg  sequence. 
The  denoised  version  is  much  cleaner  than  the  original.  We  can  also  prove 


0  500  1000  1500  2000 


FIGURE  3.11.  Denoising  an  ECG  sequence  using  a  MODWT  MRD,  The  top 
plot  shows  the  ecg  sequence.  The  bottom  plot  shows  the  summation  of  the  MRD 
crystals  D2-D6.  The  effect  is  to  remove  the  low-frequency  baseline  drift  and 
high-frequency  noise  components. 

that  a  summation  over  all  crystals  of  the  MRD  will  give  us  the  original 
sequence: 

>  vecnormC  ecgQdata  ~  reconstruct (mrd. ecg)  ) 

[1]  3.338254e-ll 

You  can  also  obtain  a  subset  of  the  components  of  an  MRD  through 
the  wavDetail  function.  The  wavDetail  function  is  highly  flexible  in  that  it 
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is  usable  for  the  DWT,  MODWT,  DWPT,  and  MODWPT.  To  illustrate, 
let  us  generate  these  transforms  for  the  first  difference  of  the  atomic  clock 
sequence  atomclock: 

>  X  <-  diff(  as. vector (atomclock)  ) 

>  x.dwt  <“  wavDWTC  x,  n. levels  =  3  ) 

>  x.dwpt  <“  wavDWPT(  x,  n. levels  =  3  ) 

>  x.modwt  <-  wavM0DWT(  x,  n. levels  =  3  ) 

>  x.modwpt  <-  wavMODWPT(  x,  n. levels  =  3  ) 

The  wavDetail  function  takes  two  arguments,  level  and  osc,  which  are  used 
to  specify  the  decomposition  level  and  oscillation  index,  respectively.  A 
(level,  osc)  doublet  defines  the  location  of  a  particular  node  or  crystal  in 
a  sequency-ordered  wavelet  packet  tree.  If  you  call  the  wavDetail  function 
without  specifying  any  values  for  level  or  osc,  then  by  default  an  MRD  is 
returned. 

>  wavDetail (  x.dwt  ) 

Wavelet  Decomposition  of  x.dwt 

Wavelet:  haar 

Length  of  series:  1026 

Number  of  levels:  3 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Signal  Components:  D1  D2  D3  S3 

>  wavDetail (  x.dwpt  ) 

Discrete  Wavelet  Packet  Decomposition  of  x.dwpt 

Wavelet:  haar 

Length  of  series:  1026 

Number  of  levels:  3 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Signal  Components:  W3.0  W3.1  W3.2  W3.3  W3.4  W3.5  W3.6  W3.7 

Notice  that,  in  the  case  where  the  transform  is  a  wavelet  packet,  an  MRD  of 
the  nodes  found  in  the  last  level  is  returned.  In  the  non-packet  transform 
case  (e.g.  in  the  DWT  or  MODWT)  the  default  action  is  to  return  the 
MRD  of  the  available  crystals  which  span  all  levels  in  the  transform.  The 
plot  method  can  be  used  to  display  the  MRD. 
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>  plot(  wavDetail(x.dwt)  ) 

>  plot(  wavDetail(x.dwpt)  ) 

The  MRD  for  the  x.dwt  and  x.dwpt  objects  are  shown  in  Fig.  3.12  and  3.13, 
respectively.  If  we  wish  to  decompose  only  those  crystals  associated  with 
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FIGURE  3.12.  DWT  multiresolution  decomposition  of  the  atomclock  differences. 

a  particular  decoposition  level,  we  can  do  so  by  specifying  the  level  in  the 
call  to  wavDetail: 

>  plot(  wavDetail  x.dwt,  level  =  3),  show. sum  =  F  ) 

Figure  3.14  shows  the  level  three  details  for  the  x.dwt  object.  You  can  also 
form  the  details  for  a  single  node  or  group  of  nodes  in  a  particualr  level 
as  well  by  specifying  both  the  level  and  osc  arguments  of  the  wavDetail 
function. 
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FIGURE  3.13.  DWPT  multiresolution  decomposition  of  the  atomclock  differ¬ 


ences. 
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FIGURE  3.14.  DWT  multiresolution  decomposition  of  the  atomclock  differences. 
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>  wavDetailC  x.modwt,  level  =  2,  osc  =  1  ) 

Maximal  Overlap  Wavelet  Decomposition  of  x.modwt 
Wavelet :  s8 

Length  of  series:  1025 
Number  of  levels:  3 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Signal  Components:  D2 

>  wavDetaiK  x.modwpt,  level  =  2,  osc  =  c(0,3)  ) 

Maximal  Overlap  Wavelet  Packet  Decomposition  of  x.modwpt 
Wavelet :  s8 

Length  of  series:  1025 
Number  of  levels:  3 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Signal  Components:  W2.0  W2.3 


NOTE:  For  non-packet  transforms  such  as  the  DWT  or  MODWT,  the 
osc  argument  in  the  wavDetail  function  must  be  set  as  osc=l  for  levels 
j  <  J  where  J  is  the  total  number  of  decomposition  levels.  For  level  j  =  J, 
the  osc  argument  must  be  set  such  that  0  <  osc  <  1.  This  format  is 
consistent  with  the  sequency  ordering  of  wavelet  packet  trees  (see  Fig,  3.8 
and  corresponding  text  for  details). 


3.6  The  Dual  Tree  Wavelet  Transform 

The  Dual-TVee  Complex  Wavelet  Transform  (DTWT)  is  a  recent  devel¬ 
opment  in  wavelet  theory  due  to  Nick  Kingsbury  at  Cambridge  Univer¬ 
sity  [Kin98,  Kin99,  KinOO].  The  research  that  resulted  in  the  DTWT  was 
motivated  by  the  quest  for  a  wavelet  transform  that  would  have  a  com¬ 
bination  of  desirable  properties,  some  of  them  shared  by  classical  wavelet 
transforms,  and  some  of  them  new.  These  are 

•  Invertibility.  The  ability  to  “perfectly”  reconstruct  the  data  after 
transformation,  i.e.  the  transform  of  a  function  has  an  inverse  and,  in 
the  absence  of  round-off  errors,  the  inverse  is  identical  to  the  original 
function.  This  property  is  eeisily  demonstrated  for  the  DTWT,  for 
example  by  transforming  a  random  sequence: 
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>  rand  <-  rnorm(  128  ) 

>  rand.dtwt  <-  wavDTWK  rand  ) 

>  rand. recon  <-  reconstruct (  remd.dtwt  ) 

>  vecnormC  rand  -  rand. recon  )  /  vecnormC  rand  ) 

[1]  7.682155e-15 

While  many  classical  wavelet  transforms  have  this  property,  the  re¬ 
quirements  for  achieving  perfect  reconstruction  can  conflict  with  those 
for  achieving  shift  invariance  and  directional  selectivity  [Kin99]. 

•  Shift  invariance.  In  the  ideal  case,  shift  invariance  would  mean 
that,  if  the  location  of  a  feature  (e.g.,  a  line  or  an  edge)  in  the  origi¬ 
nal  function  or  image  were  shifted,  then  the  wavelet  coefficients,  and 
the  components  of  the  multiresolution  decomposition,  would  exhibit 
a  similar  shift,  and  there  would  be  no  transfer  of  energy  between 
different  levels  of  the  transform.  This  property  would  be  highly  de¬ 
sirable,  but  it  is  not  found  in  the  classical  wavelet  transforms.  There, 
shifting  a  feature  often  results  in  considerable  shifting  of  energy  be¬ 
tween  different  transform  levels.  For  an  example  of  this  behavior,  see 
the  following  section.  Also  see  §5.1  of  [PWOO]. 

As  noted  in  [BG96],  it  is  possible  to  achieve  shift  invariance  by  use 
of  a  non-decimated  wavelet  transform  such  as  the  MODWT.  But, 
in  that  transform,  the  wavelet  coefficients  are  evaluated  without  any 
decimation.  Thus,  the  MODWT  achieves  shift  invariance  only  at  the 
expense  of  a  high  degree  of  redundancy,  and  with  a  considerable  in¬ 
crease  in  computation  and  data  handling. 

•  Directional  selectivity.  In  a  2D  image,  if  certain  features  are  aligned 
to  the  horizontal  at  angles  of  ±  15  deg,  ±  45  deg,  or  ±  75  deg, 
then  these  alignments  also  will  be  evident  in  the  magnitudes  of  the 
wavelet  coefficients.  Ideally,  features  aligned  in  the  positive  (-h)  direc¬ 
tions  would  be  distinct  from  those  aligned  at  the  negative  (-)  direc¬ 
tions.  Unfortunately,  achievement  of  this  ideal  has  been  elusive,  and 
classical  wavelet  transforms  show  an  equal  emphasis  of  the  +  and  - 
directions. 

•  Low  noise  amplification.  Small  changes  in  the  wavelet  coefficients 
do  not  lead  to  large  changes  in  the  reconstructed  signal.  Many  clas¬ 
sical  wavelet  transforms  do  have  this  property,  but  maintaining  it 
places  constraints  on  the  achievement  of  the  other  properties  listed 
here.  Thus,  noise  amplification  limits  the  usefulness  of  wavelet  trans¬ 
forms  based  on  a  single  tree  of  complex  filters  [dROO]. 

The  DTWT  is  a  recent  attempt  to  create  a  transform  having  the  fea¬ 
tures  described  above.  The  DTWT  retains  perfect  reconstruction,  achieves 
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a  good  (approximate)  degree  of  shift  invariance,  has  good  directional  se¬ 
lectivity,  and  has  low  noise  amplification.  These  features  do  come  with  a 
modest  degree  of  redundancy  (a  factor  of  2  in  one  dimension,  or  four  in 
two  dimensions),  but  this  is  considerably  less  than  the  redundancy  of  the 
non- decimated  wavelet  transform. 

We  note  that  Kingsbury  has  presented  two  versions  of  the  DTWT  that 
differ  in  the  types  of  filters  used.  The  first  version  was  termed  the  ‘Odd- 
Even’  version  [Kin98].  The  second,  more  recent,  version  is  termed  the 
‘Q-shift’  version  [KinOO],  It  is  the  Q-shift  version  that  is  implemented  in 
Wavelets  2.0. 

3,6.1  Some  features  of  the  DTWT 

There  are  two  principal  differences  between  the  DTWT  and  classical  wavelet 
transforms: 

1.  Decimation  of  the  transform  coefficients  is  eliminated  at  Level  1,  but 
is  retained  at  all  higher  levels.  The  output  of  the  Level  1  transform  is 
separated  into  two  streams.  The  odd-indexed  data  is  passed  into  one 
‘tree’  of  filters  that  generate  the  higher  levels  of  the  transform,  using 
a  different  set  of  filters  than  used  at  Level  1.  The  even-indexed  data 
is  passed  into  a  second  ‘tree’  of  filters  that  also  generate  the  higher 
levels  of  the  transform,  but  with  a  set  of  filters  whose  coefficients  are 
reversed  versions  of  those  in  the  first  tree.  It  is  this  dual  set  of  filter 
trees  that  is  referred  to  by  the  words  ‘Dual  Tree’  in  the  name  of  the 
transform.  The  overall  picture  is  equivalent  to  having  two  completely 
separate  trees,  each  including  the  same  Level- 1  filters,  but  with  the 
second  tree’s  Level- 1  filters  including  a  unit  delay.  This  viewpoint  is 
illustrated,  for  a  DTWT  through  Level  3,  in  Fig.  3.15.  If  additional 
levels  were  present,  their  filters  would  repeat  those  shown  for  Levels 
2  and  3, 

2.  The  filters  in  the  two  trees  are  designed  to  have  the  character  of  ‘real’ 
and  ‘imaginary’  parts  of  an  overall  complex  wavelet  transform.  (But, 
we  must  emphasize,  this  is  accomplished  with  filters  that  have  purely 
real  coefficients!)  Here,  the  ‘complex’  nature  of  the  result  must  be 
understood  in  the  analytic  signal  sense  of  the  term.  Thus,  the  mother 
wavelets  associated  with  each  tree  are  discrete  versions  of  Hilbert 
transforms  of  one  another  [SelOO].  Equivalently,  the  lowpass  filters  of 
one  tree  interpolate  midway  between  the  lowpass  filters  of  the  second 
tree  [Kin99].  Again,  we  emphasize  that  no  complex  numbers  are  in¬ 
volved  in  the  evaluation  of  the  transforms  themselves.  However,  the 
results  obtained  from  the  two  trees,  Tree  A  and  TreeB,  are  inter¬ 
preted  as  {Tree A)  -h  i{TreeB) 
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FIGURE  3.15,  The  three-level  Dual-Tree  Complex  Wavelet  Transform  as  a  filter 
bank. 


Kingsbury  has  provided  four  sets  of  filters  that  can  be  used  at  Level  1, 
and  four  sets  that  can  be  used  at  the  higher  levels.  The  Level  1  filters  all  are 
biorthogonal  filters,  and  are  termed  nearsyma,  nearsymb,  antonini,  and 
legalL  The  filters  for  use  at  the  higher  levels  all  are  quarter-shift  (‘Q-shifU) 
filters  and  are  termed  a,  6,  c,  and  d.  Specific  sets  of  filter  coefficients  can  be 
selected  via  the  function  wavKingsbury,  and  the  impulse  responses  of  the 
selected  filters  can  be  displayed,  as  in  Fig.  3,16. 

>  filts  <-  wavKingsbury (  biorthogonal="antonini" ,  qshift="b'*  ) 

>  plot(  filts,  type  =  "time”  ) 

Alternatively,  the  frequency  responses  of  the  filters  can  be  displayed,  as 
shown  in  Fig.  3.17. 

>  plot(  filts,  type  =  "gain"  ) 

The  approximate  shift-invariance  of  the  DTWT,  and  the  corresponding 
lack  of  shift-invariance  of  a  classical  wavelet  transform,  are  illustrated  in 
Fig.  3.18  and  3.19.  These  figures  compare  the  multi-resolution  decompo¬ 
sitions  of  a  sequence  of  sixteen  shifted  unit  step  functions  as  generated  by 
the  DTWT  using  the  nearsyma  and  Q-shift  a  wavelets,  and  by  a  DWT  using 
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FIGURE  3.16.  Impulse  Responses  of  DTWT  Filters.  This  example  has  selected 
the  Antonini  filters  for  Level  1  and  the  Q-Shift  b  filters  for  the  higher  levels. 
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FIGURE  3.18.  DTWT  multiresolution  decompositions  of  shifted  step  functions. 
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FIGURE  3.19.  DWT  multiresolution  decompositions  of  shifted  step  functions. 
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the  s8  wavelet.  The  upper  plot  in  each  figure  shows  the  step  functions.  As 
an  aid  in  visualization  of  the  entire  sequence,  each  successive  function  has 
been  drawn  at  a  slightly  lower  elevation.  The  next  five  plots  in  each  figure 
show  the  components  of  the  Level-4  multiresolution  decompositions  of  the 
step  functions,  specifically  the  Dl.  D2,  D3,  D4,  and  S4  components.  These 
too  have  been  drawn  with  each  successive  case  at  a  slightly  lower  elevation. 
In  every  instance,  the  original  step  function  is  the  sum  of  its  five  com¬ 
ponents.  These  detailed  figures  were  generated  by  combining  a  number  of 
similar  S-PLUS  commands  into  a  source  file.  Generation  of  any  single  com¬ 
ponent,  however,  is  straightfoward.  For  example,  if  u.step  is  a  step  function 
of  length  128  then  the  Dl  component  of  its  multiresolution  decomposition 
is  generated  by 

>  u.step  <-  c(  rep(0,64),  rep(l,64)  ) 

>  u.step.dtwt  <“  wavDTWT(  u.step,  n.levels=4  ) 

>  u.temp.dtwt  <-  u.step.dtwt 

>  u.temp.dtwtC  c('’d2",  "d3",  "d4’',  ’•s4'0  ]  <-  0 

>  Dl.step  <“  reconstruct (  u.temp.dtwt  ) 

As  Fig.  3.18  clearly  shows,  when  the  multiresolution  decomposition  is  based 
on  the  DTWT,  the  principal  effect  of  a  shift  in  step  location  is  a  corre¬ 
sponding  shift  of  each  component,  with  very  little  transfer  of  energy  be¬ 
tween  different  levels.  Figure  3.19,  however,  which  shows  the  results  for  the 
DWT,  provides  a  sharp  contrast.  While  each  step  function  still  is  the  sum 
of  its  individual  components,  none  of  the  components  exhibit  a  simple  shift 
behavior.  The  Dl  component  appears  to  oscillate  between  two  different 
shifted  states,  while  the  D2,  D3,  and  D4  components  show  major  transfers 
of  energy  between  the  different  levels.  The  S4  component  comes  closest  to 
showing  a  simple  shift,  but  it  too  has  noticeable  distortion  compared  to 
what  is  seen  in  Fig.  3.18.  The  conclusion  is  that  DTWT  achieves  a  high 
degree  of  shift  invariance  that  is  not  present  in  the  ordinary  DWT,  and  it 
does  so  at  the  expense  of  only  a  two- fold  degeneracy  (in  one  dimension). 

The  directional  selectivity  of  the  DTWT  can  be  illustrated  best  by  ap¬ 
plication  to  an  idealized  image.  To  that  end,  the  function  make. image  can 
be  used  to  construct  a  binary  image  in  the  form  of  a  twelve-petal  flower, 
as  shown  in  Fig.  3.20. 

>  posy  <-  make. image (  "flower",  nrow=256  ) 

>  par(  pty="s"  ) 

>  image (  posy,  axes=F  ) 

The  petal  centerlines  are  oriented  at  the  angles  of  15  deg,  45  deg,  75  deg, 
...  to  the  horizontal.  The  two-dimensional  DTWT  of  the  flower  can  be 
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FIGURE  3.20.  Binary  image  of  an  idealized  twelve-petal  flower  as  a  256  x  256 
matrix. 
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evaluated,  and  the  magnitudes  of  different  combinations  of  the  DTWT 
coefficients  can  be  displayed  as  in  Fig.  3.21. 

>  posy.dtwt  <-  wavDTWT.2d(  posy,  n.levels=3  ) 

>  plot(  posy.dtwt  ) 


s2-d2  (+15) 

s2-d2  (-15) 

-  X 

y 

d2-d2  (+45) 

d2-d2  (-45) 

/  i 

d2-s2  (+75) 

d2-s2  (-75) 

'  ■ 

FIGURE  3.21.  Complex  magnitudes  of  the  DTWT  of  the  flower  image. 

Features  in  the  image  that  are  oriented  at  different  angles  have  their  coun¬ 
terparts  in  the  DTWT  coefficients.  Different  orientations  can  be  empha¬ 
sized  by  selecting  DTWT  coefficients  associated  with  different  combinations 
of  lowpass  (scaling)  and  highpass  (wavelet)  filter  outputs  in  the  transforms 
of  the  rows  and  columns.  Thus,  at  any  particular  level,  the  row  coefficients 
and,  independently,  the  column  coefficients  can  be  associated  with  either 
the  highpass  filters  or  the  lowpass  filters.  Positive  or  negative  angular  ori¬ 
entations  are  emphasized  in  the  DTWT  by  choosing  the  ‘imaginary’  parts 
of  the  row  and  column  transforms  to  be  associated  with  imaginary  units 
‘i’  having  the  same  algebraic  signs,  or  the  opposite  algebraic  signs,  respec¬ 
tively.  In  the  analytic  signal  interpretation,  this  corresponds  to  the  selection 
of  frequency  ranges  in  the  row  and  column  transforms  that  have  the  same 
algebraic  signs,  or  the  opposite  signs,  respectively.  Of  course,  we  display  the 
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complex  magnitudes  of  the  wavelet  coefficients.  This  ability  to  emphasize 
positive  and  negative  orientations  separately  is  unique  to  the  DTWT  and 
would  not  be  seen  in  a  display  based  on  a  real  DWT. 

An  enlarged  view  of  any  one,  or  more,  of  the  six  small  images  in  Fig.  3.21 
also  can  be  obtained.  For  example,  the  +45  deg  image  is  shown  in  Fig.  3.22. 

>  plot(  posy.dtwt,  aiigle=+45  ) 


62-62  (+45) 


FIGURE  3.22.  Complex  magnitude  of  the  DTWT  of  the  flower  image  to  empha¬ 
size  features  at  +45  deg. 

It  is  possible  to  suppress  less  prominent  features  in  the  plot  of  a  DTWT 
by  use  of  the  threshold  argument  in  plot.  This  argument  ranges  from  0  to 
1,  and  has  the  default  value  1.  For  example: 

>  plot(  posy.dtwt,  angle=+45,  threshold=0 . 8  ) 

The  result  is  shown  in  Fig.  3.23,  which  displays  the  same  DTWT  image  as 
in  Fig.  3.22  but  plotted  with  threshold  =  0.8.  The  effect  of  this  setting  is 
to  plot  a  zero  for  any  DTWT  coefficient  whose  complex  magnitude  is  less 
than  0.8  times  the  maximum  amplitude  of  the  DTWT. 
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d3-d3  (+45) 


FIGURE  3.23.  Complex  magnitudes  of  the  DTWT  of  the  45  deg  flower  image 
plotted  with  threshold  =  0.8. 
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While  the  directional  selectivity  of  the  DTWT  is  most  striking  for  an 
idealized  image,  such  as  the  flower,  it  also  is  apparent  with  images  from 
the  real  world.  As  an  illustration,  we  consider  the  classical  Lena  image 
shown  in  Fig.  3.24  as  a  512  x  512  pixel  gray-scale  image. 

>  image (  lena,  axes=F  ) 


FIGURE  3.24.  The  Lena  Image 


The  magnitudes  of  the  DTWT  coefficients  of  the  Lena  image  are  shown  in 
Fig.  3.24. 

>  lena.dtwt  <-  wavDTWT.2d(  lena,  n.levels=2  ) 

>  plot(  lena.dtwt  ) 
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FIGURE  3.25.  Complex  magnitudes  of  the  Level-2  DTWT  of  the  Lena  image. 
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An  expanded  view  of  any  one,  or  more,  of  the  small  images  also  can  be 
displayed.  For  example,  a  view  of  the  images  for  the  angles  ±45  deg  is 
obtained  via  the  commands 

>  plot(  lena.dtwt,  angle=c(+45,-45)  ) 


62-62  (±45) 


62-62  (-45) 


FIGURE  3.26.  Complex  magnitudes  of  DTWT  of  the  Lena  image  selected  to 
emphasize  features  oriented  at  ±45  deg. 

and  is  shown  in  Fig.  3.26.  The  ability  of  the  DTWT  to  emphasize  features 
oriented  at  specific  angles  in  the  image  is  apparent. 
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Wavelet  variance  analysis  is  a  method  of  partitioning  the  variance  of  a  time 
series  into  pieces  that  are  associated  with  different  scales.  This  type  of  anal¬ 
ysis  tells  us  what  scales  are  important  contributors  to  the  overall  variability 
of  a  time  series.  Wavelet  variance  analysis  has  been  found  to  be  useful  in 
the  analysis  of,  e.g.,  financial  time  series,  genome  sequences,  frequency  fluc¬ 
tuations  in  atomic  clocks,  changes  in  the  variance  of  soil  properties,  canopy 
gaps  in  forests,  the  accumulation  of  snow  fields  in  the  polar  regions,  turbu¬ 
lence  in  the  atomosphere  and  ocean,  and  regular  and  semiregular  variable 
stars. 

Wavelet  variance  analysis  involves  the  estimation  of  a  sequence  of  the¬ 
oretical  quantities  called  the  wavelet  variance  (see  Section  4.1  below  for  a 
precise  definition) .  Each  term  in  this  sequence  is  associated  with  a  particu¬ 
lar  scale  Tj  =  2-?“^  i  =  1, 2, 3, . . ..  If  we  regard  the  time  series  Xq,  Xi, . . . ,  Xn-i 
under  analysis  as  a  realization  of  a  portion  of  a  stationary  process  with  vari¬ 
ance  a^x  denote  the  wavelet  variance  for  scale  tj,  then 

we  have  the  fundamental  relationship 

oo 

i=i 

The  above  relationship  is  analogous  to  the  fundamental  relationship  be¬ 
tween  the  variance  of  a  stationary  process  and  its  spectral  density  function 
(SDF).  If  we  let  Sx{f)  denote  this  SDF  at  the  frequency  /  €  [-1/2, 1/2], 
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then  we  have 

rlf2 

cy\=  Sx{f)df, 

7-1/2 

Thus,  just  as  the  SDF  for  a  stationary  process  decomposes  the  process  vari¬ 
ance  across  different  frequencies,  so  does  the  wavelet  variance  decompose 
it  across  different  scales. 

The  wavelet  variance  is  of  interest  for  the  following  reasons. 

•  Because  the  wavelet  variance  offers  a  scale-by-scale  decomposition 
of  the  variability  in  certain  stochastic  processes,  it  has  considerable 
appeal  for  researchers  studying  processes  that  exhibit  fluctuations 
over  a  range  of  different  scales.  Such  processes  commonly  occur  in, 
e.g.,  the  atmospheric  sciences  and  oceanography. 

•  The  wavelet  variance  is  closely  related  to  the  concept  of  the  SDF. 
Both  provide  an  analysis  of  the  variance  of  a  stationary  process  across 
a  physically  interpretable  independent  variable  (frequency  in  the  case 
of  the  SDF,  and  scale  in  the  case  of  the  wavelet  variance).  Since 
the  scale  tj  can  be  related  to  a  range  of  frequencies  in  the  interval 
[l/2^'"^l/2^’],  the  wavelet  variance  often  leads  to  a  more  succinct 
decomposition.  In  addition,  the  square  root  of  the  wavelet  variance 
has  the  same  units  as  the  original  data,  which  can  make  it  more  easily 
interpretable  than  the  SDF  (if  the  units  for  the  time  series  are  in,  say, 
meters,  and  if  the  time  between  observations  is  in,  say,  seconds,  then 
the  units  for  the  SDF  are  in  meters  squared  per  Hertz,  where  a  Hertz 
is  defined  to  be  one  cycle  per  second). 

•  For  certain  stationary  processes,  the  sample  variance  of  a  time  series, 
namely, 


-  N-i  _  _  ^  ^-1 

^X  =  JJ  where  X  =  —  Xt, 

t=0  t—0 

can  grossly  underestimate  the  process  variance  even  when  the 
sample  size  N  is  quite  large.  For  these  processes,  the  wavelet  vari¬ 
ance  is  a  useful  substitute  because  it  replaces  the  problematic  notion 
of  a  ‘global’  variance  with  a  sequence  of  variances  over  particular 
scales,  for  which  we  can  readily  formulate  unbiased  estimators.  In 
addition,  the  wavelet  variance  is  well-defined  and  can  be  easily  esti¬ 
mated  for  certain  nonstationary  processes  for  which  the  variance  is 
either  infinite  or  an  ever  increasing  function  of  the  sample  size  N. 
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4.1  Definition  of  the  Wavelet  Variance 

Let  hjj  be  the  level  j  equivalent  MODWT  wavelet  filter  based  upon  the 
MODWT  wavelet  and  scaling  filters  hi  and  gi  of  width  L  (see  Section  3.2.1 
for  details).  Let  {Xt,  t  =  . . . ,  -1, 0, 1, . . .}  represent  a  discrete  parameter 
stochastic  process,  i.e.,  a  collection  of  random  variables  (RVs)  indexed  by 
the  set  of  all  integers.  Define  the  level  j  MODWT  wavelet  coefficients  for 
this  process  as 

dj^t  ~ 

/=0 

where  t  ranges  over  all  the  integers.  By  definition,  the  \^^velet  variance 
i^xiTj)  for  scale  tj  =  is  defined  to  be  the  variance  of  djy. 

I'xiTj)  =  var{dj,t}. 

If  we  make  certain  assumptions  about  the  process  {Xt},  then  v%{Tj)  will 
be  finite  and  independent  of  the  time  index  t,  and  moreover  we  will  have 
E{dj^t}  =  0  so  that  =  var{dj,t}  (for  these  conditions  to  hold,  it 

suffices  that  the  backward  differences  of  {Xt}  of  a  certain  order  constitute  a 
zero  mean  stationary  process;  see  Chapter  8  of  Percival  and  Walden,  2000, 
for  details).  In  what  follows,  we  assume  that  ^'x(d)  these 

conditions. 


4.2  Estimation  of  the  Wavelet  Variance 

Suppose  now  that  we  have  a  time  series  of  N  values  that  we  regard  as  a 
portion  Xq,  Xu  ^7V-i  of  a  stochastic  process  {Xt}>  Let  {hi}  be  a 
MODWT  wavelet  filter  of  width  L,  and  assume  that  {Xt}  satisfies  condi¬ 
tions  such  that  the  wavelet  variance  scale  tj  =  based  upon 

this  filter  is  finite  and  independent  of  time.  Let  Lj  =  {2^  -  1)(L  -  1)  + 1  be 
the  width  of  the  equivalent  MODWT  filter  for  level  j  (when  j  =  1, 
we  have  hi,/  =  hi  and  Li  =  L).  Then  the  unbiased  MODWT  estimator  of 
the  wavelet  variance  is  defined  as 


N-l 


^xi^j)  =  Tr.  H  4t> 

^  t=Lj-l 


where  dj^t  is  the  MODWT  wavelet  coefficient  at  level  j  and  time  index 
and  Mjkx  -  Lj  -f  1  (we  assume  that  Mj  >  1).  Note  that,  while  there  are 
N  MODWT  wavelet  coefficients  at  each  level  j,  we  only  use  the  last  Mj  of 
these.  The  unbiased  wavelet  variance  estimator  avoids  the  first  Lj  ^  1  coef¬ 
ficients  on  each  level  because  these  are  the  so-called  boundary  coefficients; 
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i.e,,  these  coefficients  make  explicit  use  of  the  circularity  assumption  built 
into  the  MODWT  and  hence  are  formed  by  combining  together  values  both 
at  the  beginning  and  the  end  of  the  time  series,  with  the  result  that  E{(^j  ^} 
need  not  be  equal  to  v\{Tj).  If  we  retain  these  boundary  coefficients,  we 
obtain  a  biased  MODWT  estimator  of  the  wavelet  variance,  namely. 


N-l 


fSrC’V)  =  jjT,  ‘'1.- 


t=0 


The  DWT  can  also  be  used  to  formulate  estimators  of  the  wavelet  vari¬ 
ance,  but  the  sampling  properties  of  these  estimators  are  generally  inferior 
to  those  of  the  MODWT  estimators.  Let  ATj  =  [N/2^\  be  the  number  of 
DWT  wavelet  coefficients  at  level  j,  and  !'•  =  \{L  -  2)(1  -  2"^)1  be  the 
number  of  DWT  boundary  coefficients  at  level  j  (assuming  TVj  >  L'j). 
Then  the  DWT  version  of  the  unbiased  estimator  of  the  wavelet  variance 


is  defined  as 


J  Ni-l 


4*. 


where  is  the  DWT  coefficient  at  level  j  and  time  index  t.  Similarly,  the 
DWT  version  of  the  biased  wavelet  variance  is  defined  as 


yv'- 


:(d)  = 


N'j2^ 


t=0 


dlf 


4.3  Distribution  of  Wavelet  Variance  Estimators 

An  approximation  to  the  distribution  of  the  unbiased  MODWT  wavelet 
variance  estimator  {tj)  has  been  worked  out  and  can  be  used  to  assess  its 
sampling  variability  and  to  obtain  confidence  intervals  for  the  true  wavelet 
variance  Sections  8.3  and  8.4  of  Percival  and  Walden,  2000,  for 

details).  This  approximation  is  based  on  the  assumption  that  the  statistic 
^  distribution  that  is  equal  to  an  RV  given  by  the  product  of 
a  chi-square  RV  with  r]  degrees  of  freedom  and  the  constant 
The  starting  point  for  this  approximation  is  to  note  that,  if  we  have  M 
independent  and  identically  distribution  Gaussian  RVs  with  mean  zero, 
then  the  sum  of  their  squares  forms  an  RV  whose  distribution  is  given 
by  the  product  of  a  chi-square  RV  Xm  with  M  degrees  of  freedom  and  a 
constant.  By  assumption,  the  MODWT  wavelet  coefficients  dj^i  that  we 
use  to  form  Gaussian  RVs  with  mean  zero  and  variance 

however,  because  these  coefficients  are  in  general  correlated  with  each  other, 
their  sum  of  squares  is  not  a  chi-square  RV  with  Mj  degrees  of  freedom.  We 
can  adjust  for  this  correlation  by  setting  7}  equal  to  a  value  such  that  the 
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RV  has  the  same  theoretical  variance  as  i>xirj)  (we  can  obtain 

a  good  approximation  to  this  theoretical  variance  by  appealong  to  a  large 
sample  approximation).  In  this  approach,  77  is  known  as  the  ‘equivalent 
degrees  of  freedom’  (EDOF)  and  in  effect  becomes  a  parameter  that  we 
need  to  determine  somehow. 

The  SH- Wavelets  module  supports  three  different  modes  for  setting  the 
EDOF  77. 

1.  EDOF  fji  (based  upon  large  sample  theory): 

MjO^xiTj) 

’’'--JT- 


where 


Aj  = 


—  (D'  ) 


Mj-l 

T  =  1 


and  Sj,r  is  a  sample  lag  r  autocovariance  defined  by 

dj^tdj^t^\T\  0  <  |t|  <  Mj  -  1. 


t-Li-l 


2.  EDOF  7)2  (based  upon  the  assumption  that  the  shape  of  the  SDF 
for  {Xt}  is  known  a  priori): 

where  fk  =  k/Mj  and  Cj{f)  a  nfKDSxif)-  i-e-,  the  product  of 
the  squared  gain  function  for  the  Daubechies  MODWT  equivalent 
wavelet  filter  for  level  j  and  the  SDF  for  {Xt}  (assumed  to  be 

known  up  to  a  constant  of  proportionality). 

3.  EDOF  Tjz  (large  sample  approximation  based  upon  a  band-pass 
approximation): 


7)3  =  max{Mj/2^1}. 

Once  T]  has  been  set  to  either  r)i ,  7)2  or  7)3 ,  we  can  calculate  an  approxi¬ 
mate  100(1  -  2p)%  confidence  interval  for  r'xC'D') 

Q„(l  -p)’  Qrj(p)  J’ 

where  <5„(p)  is  the  px  100%  percentage  point  for  the  chi-square  distribution 
with  T]  degrees  of  freedom  (setting  p  =  0.025  yields  an  approximate  95% 
confidence  interval). 
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4.4  The  Wavelet  Variance  Object 

The  wavVariance  function  calculates  the  wavelet  variance  of  a  real- valued 
uniformly-sampled  time  series  and  returns  an  object  of  class  WaveletVari- 
ance.  Several  methods  are  available  to  the  user  to  view,  summarize  and 
access  the  data  contained  in  a  WaveletVariance  object: 

Summary  Operator  Methods: 

print  Prints  useful  information  regarding  the  wavelet  vari¬ 

ance  including: 

•  Type  of  wavelet  transform. 

•  Information  regarding  the  filter  set, 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names, 

•  The  scale  of  each  crystal. 

plot  Plots  the  wavelet  variance  estimates.  The  plot  func¬ 

tion  has  two  optional  arguments  type  and  edof.  Set 
type  to  "unbiased”  or  "biased"  to  plot  unbiased  or  bi¬ 
ased  estimates,  respectively.  To  select  the  EDOF  mode 
of  confidence  intervals  to  be  plotted,  set  edof  to  a  vec¬ 
tor  of  integers  representing  the  desired  EDOF  mode  as 
a  third  argument  (e.g.,  c(l,  3)  for  both  EDOF  mode 
1  and  3). 

summary  Displays  a  statistical  summary  of  the  transform  data. 

Data  Access  Methods 


$  Use  to  access  specific  components  of  the  class  object. 

A  list  of  accessible  components  can  be  generated  using 
the  names  function. 
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4.5  Example:  Wavelet  Variance  of  Atomic  Clock 
Data 

>  var. clock  <-  wavVairianceC  atomclock,  n. levels  =  5  ) 

>  Riimmary (  vax. clock  ) 

MODWT  wavelet  vatriance  of  atomclock 

dl  d2  d3  d4  d5 

Biased  3.5e+00  5.0e+00  9.2e+00  1.8e+01  3.6e+01 
Unbiased  2.4e-06  5.6e~06  1.5e-05  4.1e-05  1.7e-04 

Confidence  Interval  Data  for  Unbiased 
Time  Independent  Wavelet  Variaince: 


dl 

d2 

d3 

d4 

d5 

Level 

1 

2 

3 

4 

5 

Scale 

1 

2 

4 

8 

16 

[EDOFl] 

805 

353 

172 

99 

50 

[ED0F2] 

NA 

NA 

NA 

NA 

NA 

[ED0F3] 

510 

251 

122 

58 

25 

#  coeffs 

1019 

1005 

977 

921 

809 

The  summary  method  for  the  WaveletVariance  object  gives  a  complete  pic¬ 
ture  of  the  wavelet  variance  estimates  as  well  as  the  EDOF  and  correspond¬ 
ing  confidence  intervals.  To  plot  the  data,  simply  invoke  the  plot  method 
using  an  optional  character  string  to  denote  biased  or  unbiased  estimates 
as  a  second  argument  and  a  vector  denoting  the  EDOF  mode  to  use  in 
displaying  the  confidence  intervals  as  an  optional  third  argument: 

>  plot(  var. clock,  type  =  "unbiased”,  edof  =  c(l,3)  ) 

Figure  4.1  shows  the  wavelet  variance  versus  scale  (measured  in  days)  for 
an  atomic  clock  sequence  formed  by  measuring  the  difference  in  time  kept 
by  a  clock  571  and  by  an  ensemble  of  cesium  beam  atomic  clocks  used  in  the 
1970s  by  the  US  Naval  Observatory  to  form  the  official  time  scale  for  the 
US.  The  fact  that  the  values  of  the  wavelet  variance  for  the  four  smallest 
scales  (1  to  8  days)  lie  roughly  on  a  line  in  a  log/log  plot  indicates  that 
the  SDF  varies  approximately  as  a  power  law  over  the  corresponding  range 
of  frequencies  (i.e.,  1/32  to  1/2  cycles  per  day).  The  fact  that  the  wavelet 
variances  increase  monotonically  with  scale  indicates  that  the  ability  of 
clock  571  to  keep  time  decreases  as  the  time  span  (scale)  increases. 

The  DWT  estimation  of  the  wavelet  variance  can  also  be  calculated  by 
setting  the  transform  argument  appropriately. 


Unbiased  MODWT  Wavelet  Variance  ( s8 ) 
1e-05  0.0001 


64 


4.  Wavelet  Variance  Analysis 


Wavelet  Variance  of  atomclock:  EDOF  Mode  1 


Scale  (day) 


EDOF  Mode  3 


Scale  (day) 


FIGURE  4.1.  Unbiased  MODWT  wavelet  variance  estimates  of  the  atomclock 
time  series  for  levels  j  =  1, . . . ,  5  using  Daubechies  s8  filters.  The  left  and  right 
plots  display  confidence  intervals  using  EDOF  mode  1  and  3,  respectively. 
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>  wavVariance(  atomclock,  transform  =  "dwt”  ) 

DWT  wavelet  variance  of  atomclock 
Wavelet:  s8 

Length  of  series:  1026 
Number  of  levels:  7 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Sampling  interval:  1 

dl  d2  d3  d4  d5  d6  d7 
Scales  1  2  4  8  16  32  64 


NOTE:  No  confidence  limits  are  available  for  the  DWT  wavelet  wavelet 
variance  estimator.  The  default  transform  (MODWT)  also  produces  more 
accurate  estimates  than  does  the  DWT  version  and  can  be  used  to  produce 
instantaneous  variance  estimates. 


4.6  Other  Wavelet  Variance  Functions 

You  can  also  use  the  wavEDOF  and  wavVarianceConfidence  functions  in¬ 
dividually  to  obtain  ED  OF  and  wavelet  variance  confidence  interval  es¬ 
timates,  respectively.  Here,  we  estimate  the  EDOF  and  wavelet  variance 
confidence  intervals  for  the  ocean  vertical  shear  time  series: 
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>  edof  <-  wavEDOF (ocean) 

>  edof 

$ED0F1: 

dl  d2  d3  d4  d5  d6 

1808.758  940.1328  522.7423  274.3481  78.1384  81.87458 

d7  d8  d9 

27.16933  18.4152  6.777816 

$ED0F2: 

[1]  NA  NA  NA  NA  NA  NA  NA  NA  NA 

$ED0F3: 

dl  d2  d3  d4  d5  d6 

2044.5  1018.75  505.875  249.4375  121.2188  57.10938 

d7  d8  d9 

25.05469  9.027344  1.013672 

$var iance . unbiased : 

dl  d2  d3  d4 

0.0002309741  0.0004410549  0.0005715682  0.001836403 

d5  d6  dl  d8  d9 

0.009440761  0.04758687  0.4106984  0.9862548  0.469676 

$n. coeff : 

dl  d2  d3  d4  d5  d6  d7  d8  d9 
4089  4075  4047  3991  3879  3655  3207  2311  519 

The  wavEDOF  function  returns  a  list  with  members  variance. unbiased  and 
EDOFl,  EDOF2.  EDOF3  which  can  be  used  as  inputs  to  the  wavVariance- 
Confidence  function.  Note  that  (in  general)  only  unbiased  wavelet  variance 
estimates  are  suitable  for  confidence  interval  estimation  so  the  unbiased 
version  is  accordingly  not  returned  by  wavEDOF .  To  calculate  the  95% 
confidence  intervals  corresponding  to  EDOF  mode  1  we  call  the  wavVari- 
anceConfidence  function  as  follows: 
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>  wavConf idenceLimits (  edof$variaiice. unbiased,  edof$ED0Fl  ) 
$low: 

dl  d2  d3  d4 

0.0002188667  0.0004094998  0.0005177851  0.001604601 

d5  d6  d7  d8  d9 

0.007393772  0.03746485  0.2767846  0.6179611  0.2262995 

$high; 

dl  d2  d3  d4 

0.0002441744  0.0004766303  0.000634739  0.002125904 

d5  d6  d7  d8  d9 

0.01255137  0.06281859  0.6854098  1.874926  1.468822 

The  result  shows  the  low  and  high  95%  confidence  interval  limits  based 
on  the  unbiased  wavelet  variance  estimates  and  the  chi-square  EDOF  esti- 
mates. 


4.7  Testing  for  Homogeneity  of  Variance 

An  implicit  assumption  we  have  made  in  constructing  an  estimator  of  the 
wavelet  variance  is  that  var  {dj^t}  does  not  depend  upon  the  time  index  t] 
i.e.,  we  are  assuming  that  the  variances  of  the  MODWT  wavelet  coefficients 
iare  homogeneous  across  time.  If  this  assumption  appears  to  be  question- 
able  for  a  particular  time  series,  we  can  perform  a  statistical  test  based 
upon  the  corresponding  DWT  (recall  that  we  can  extract  the  DWT  coeffi¬ 
cients  from  the  MODWT  coefficients  by  an  appropriately  subsampling  and 
rescaling  the  latter) . 

The  wavVarianceHomogeneity  function  tests  for  homogeneity  of  variance 
for  each  level  of  a  DWT  decomposition.  Based  on  the  assumption  that  the 
DWT  decorrelates  the  data,  the  nonboundary  (interior)  wavelet  coefficients 
in  a  given  level  (dj)  can  be  regarded  as  a  zero  mean  Gaussian  white  noise 
process.  For  a  homogeneous  distribution  of  dj,t,  there  is  an  expected  lin¬ 
ear  increase  in  the  cumulative  energy  as  a  function  of  time.  The  so  called 
D-statistic  denotes  the  maximum  deviation  of  the  dj^t  from  a  hypothetical 
linear  cumulative  energy  trend.  This  D-statistic  is  then  compared  to  per¬ 
centage  points  dictated  by  the  distribution  of  D  under  the  null  hypothesis 
that  the  variance  is  in  fact  homogeneous.  Comparing  the  D-statistic  for 
the  dj^i  values  o  the  corresponding  percentage  points  provides  a  means  of 
quantitatively  rejecting  or  failing  to  reject  the  null  hypothesis. 

The  wavVarianceHomogeneity  function  can  be  used  to  perform  a  homo¬ 
geneity  test  on  a  level  by  level  basis.  This  function  accpets  a  number  of 
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input  arguments  that  are  used  to  specify  how  the  test  is  to  be  performed. 
The  main  arguments  are  an  input  time  series  as  well  as  the  optional  argu¬ 
ments;  wavelet,  n. levels,  significance,  lookup,  n. realization,  n. repetition.  The 
arguments  wavelet  and  n. levels  are  the  same  as  those  used  for  the  wavelet 
transforms.  The  remaining  optional  arguments  are  used  as  used  to  de¬ 
termine  the  percentage  points  under  the  null  hypothesis.  An  Inclan-Tiao 
approximation  to  the  percentage  points  is  used  for  sample  sizes  N  >  128 
while  a  Monte  Carlo  technique  is  used  for  N  <  128,  For  the  Monte  Carlo 
technique,  the  D-statistic  for  a  Gaussian  white  noise  sequence  of  length  N 
is  calculated.  This  process  is  repeated  n. realization  times,  forming  a  distri¬ 
bution  of  the  D-statistic  under  the  null  hypothesis.  The  upper  10%,  5% 
and  1%  percentage  points  based  upon  n. realization  realizations  are  formed 
a  total  of  n. repetition  times,  and  averaged  to  form  an  estimate  of  the  true 
percentage  points  for  the  D-statistic.  Because  the  Monte  Carlo  study  can 
be  both  computationally  and  memory  intensive,  it  is  highly  recommended 
that  lookup  be  set  to  TRUE,  its  default  value. 

As  an  example,  let  us  apply  the  test  for  homogeneity  of  variance  to  the 
fdp045  series  (a  simulated  stochastic  fractal  time  series).  To  begin  the  test, 
we  simply  call  the  wavVarianceHomogeneity  function. 
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>  wavVarianceHomogeneityC  fdp045  ) 

Homogeneity  Test  for  Discrete  Wavelet  Transform  of  fdp045 


Pass: 

10*/.  5*/.  1'/. 
d6  F  T  T 

d5  T  T  T 

d4  F  T  T 

d3  T  T  T 

d2  T  T  T 

dl  T  T  T 

D-statistic  critical  values  comparison: 

N  D  loy.  5*/. 

d6:  Monte  Carlo  2  0.99561682  0.9931909  0.9984854 

d5:  Monte  Carlo  10  0.26449419  0.5027442  0.5577445 

d4:  Monte  Carlo  26  0.34851101  0.3185281  0.3549792 

d3:  Monte  Carlo  58  0.09888661  0.2183442  0.2425481 

d2:  Monte  Carlo  123  0.10464938  0.1515953  0.1679855 

dl:  Inclan-Tiao  253  0.03866207  0.1088155  0.1207195 

ly. 

d6:  Monte  Carlo  0.9999397 
d5 :  Monte  Carlo  0 . 6590028 
d4:  Monte  Cairlo  0.4280126 
d3:  Monte  Carlo  0.2945787 
d2:  Monte  Carlo  0.2028810 
dl:  Inclan-Tiao  0.1447117 

Lookup :  TRUE 

Incleui-Tiao  tolerance:  le-06 
Repetitions:  3  (lookup),  3  (non-lookup) 

Realizations/repetition:  10000  (lookup),  10000  (non-lookup) 

Wavelet :  s8 

Length  of  series:  512 

Number  of  levels:  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 
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4.8  Estimation  of  the  Wavelet  Covariance 

In  a  manner  analogous  to  how  we  defined  the  wavelet  variance  for  a  time 
series,  we  can  define  a  wavelet  covariance  between  two  time  series.  The 
wavCova fiance  function  is  used  to  estimate  the  wavelet  covariance  of  two 
sequences.  As  in  the  case  of  the  wavelet  variance,  we  can  formulate  biased 
and  unbiased  estimators  of  the  wavelet  covariance  based  upon  either  the 
MODWT  or  the  DWT.  Given  the  time  series  Xq,  Xi,  . . , ,  X^-i  and  Yq, 
Ki,  . . . ,  the  MODWT  biased  and  unbiased  estimators  of  the  wavelet 

covariance  are  defined  as 

t-0 

Unbiased:  (^-2) 

where,  as  before,  Mj  =  N-  Lj  + 1  is  the  number  of  nonboundary  (interior) 
MODWT  wavelet  coefficients,  and  Lj  =  (2^  -  1)(L  - 1)  + 1  is  the  length  of 
the  level  j  MODWT  equivalent  filter  {hjj}.  An  integer  lag  can  be  used 
to  study  the  covariance  between  to  processes  whose  events  are  assumed 
to  be  correlated  at  different  times.  For  example,  the  lagged  biased  wavelet 
covariance  is  defined  as 

Biased,  Lagged:  mod  tv-  (‘^•3) 

^  t=0 

The  wavelet  covariance  can  also  be  estimated  using  DWT  wavelet  coeffi¬ 
cients.  Given  the  same  time  series  as  before,  the  DWT  biased  estimator  of 
the  wavelet  covariance  is  defined  as 

Biased:  fxY  =  4  IZ 

^  t~0 

where  Nj  =  N/2^  for  i  =  1, . . . ,  J.  As  before,  only  the  nonboundary  (in¬ 
terior)  wavelet  coefficients  are  used  to  form  the  corresponding  unbiased 
DWT-based  wavelet  covariance  estimator.  Assuming  that  Nj  >  L'-,  this 
estimator  is  given  by 

Unbiased:  i'xY  =  ^  Y  (4-5) 

t=L'. 

where  Mj  =  N-2^L'j  with  L'-  =  [(L-2)(l-2-J)l  (for  large  j,  L'j  =  L-2). 
The  lagged  biased  wavelet  covariance  estimator  is  defined  as 

TV,-1 

Biased,  Lagged:  UxY.<t>  -  2^  ®j,t  ^j.t+<t,  mod  Nj- 


(4.6) 


4.8  Estimation  of  the  Wavelet  Covariance  71 


As  a  simple  (and  somewhat  artificial)  example,  let  us  perform  the  wavelet 
covariance  calculations  for  consecutive  1024  point  segments  of  the  sunspots 
series. 

>  sunl  <-  sunspots [1: 1024] 

>  sun2  <-  sunspots [(1 : 1024) +1024] 

>  xcov  <-  wavCovarianceC  sunl,  sun2  ) 

>  xcov 

MODWT  wavelet  covariance  of  x  and  y 
Wavelet :  s8 

Length  of  series:  1024 
Number  of  levels:  7 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Scales : 

dl  d2  d3  d4  d5  d6  d7 

1  2  4  8  16  32  64 

Lags: 

dl  d2  d3  d4  d5  d6  d7 

0  0  0  0  0  0  0 

>  plot(  xcov  ) 

The  results  are  shown  in  Fig.  4.2.  There  is  an  apparent  lag  between  the 
two  sequences  of  approximately  75  points.  We  can  impose  a  corresponding 
lag  in  the  wavelet  covariance  results. 
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Unbiased  Wavelet  Covariance 
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FIGURE  4.2.  The  discrete  wavelet  covariance  of  the  successive  sun-spots  series. 
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>  xcov.lag  <-  wavCovarianceC  sunl,  siin2,  lag  -  75  ) 

>  xcov.lag 

MODWT  wavelet  covariance  of  x  and  y 
Wavelet:  s8 

Length  of  series:  1024 
Number  of  levels:  7 
Boundary  correction  rule:  periodic 
Filtering  technique:  convolution 
Scales : 

dl  d2  d3  d4  d5  d6  d7 
1  2  4  8  16  32  64 

Lags: 

dl  d2  d3  d4  d5  d6  d7 
75  75  75  75  75  75  75 

>  plot(  xcov  ) 

The  results  are  shown  in  Fig.  4.3.  Relative  to  Fig.  4.2,  the  convariance 
results  shown  in  Fig.  4.3  exhibit  a  shift  in  covariance  over  various  scales  in 
the  data.  The  lag  argument  may  also  be  used  to  specify  different  lags  for 
different  decomposition  levels. 

>  wavCovarianceC  s\ml,  sun2,  lag  =  c(20,  30,  40)  ) 

MODWT  wavelet  covariance  of  x  and  y 
Wavelet:  s8 

Length  of  series:  1024 

Number  of  levels:  7 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

Scales: 

dl  d2  d3  d4  d5  d6  d7 

1  2  4  8  16  32  64 

Lags : 

dl  d2  d3  d4  d5  d6  d7 

20  30  40  40  40  40  40 

Notice  that  if  the  length  of  the  lag  vector  is  less  than  the  number  of  de¬ 
composition  levels,  then  the  the  last  lag  is  replicated  accordingly. 
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FIGURE  4.3.  The  discrete 
imposed  lag  (/>  =  75  for  each 
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Wavelet-Based  Analysis  of  Fractionally 
Differenced  Processes 


In  recent  years  there  has  been  considerable  interest  in  using  stochastic  pro¬ 
cesses  with  so-called  ‘power-law’  or  ‘fractal’  properties  as  models  for  various 
financial,  biomedical  and  geophysical  time  series.  Specific  applications  for 
these  processes  include 

•  forward  premiums,  interest  rate  differentials  and  inflation  rates  [Bai96]; 

•  voltage  fluctuations  across  cell  membranes; 

•  density  fluctuations  in  sand  passing  through  an  hour  glass; 

•  traffic  fluctuations  on  Japanese  expressway; 

•  impedance  fluctuations  in  geophysical  borehole; 

•  fluctuations  in  the  rotation  of  the  earth;  and 

•  X-ray  time  variability  of  galaxies. 

The  basic  idea  behind  such  processes  is  that  their  spectral  density  func¬ 
tions  (SDFs)  vary  as  a  power  law  over  certain  ranges  of  frequencies.  Early 
attempts  (dating  from  the  1960s)  at  defining  stochastic  processes  that  cap¬ 
ture  these  ideas  include  fractional  Brownian  motion  (FBM)  and  fractional 
Gaussian  noise  (FGN),  both  of  which  have  seen  wide  usage.  In  the  early 
1980s,  Granger  and  Joyeux  [GJ80]  and  Hosking  [Hos81]  introduced  a  flexi¬ 
ble  class  of  models  known  as  fractionally  differenced  (FD)  processes.  An  FD 
process  can  be  regarded  as  an  extension  to  an  autoregressive,  integrated. 
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moving  average  model  in  which  the  order  of  integration  is  allowed  to  as¬ 
sume  non-integer  values,  and  the  orders  for  the  autoregressive  and  moving 
average  processes  are  both  set  to  zero.  FD  processes  capture  the  power-law 
and  fractal  ideas  in  a  flexible  and  tractable  manner  and  have  the  following 
advantages  over  FBM  and  FGN. 

•  Unlimited  power  law  exponent  range.  Both  FBM  and  FGN  are 
stochastic  power  law  processes  because  their  SDFs  are  approximately 
proportional  to  |/1^  at  low  frequencies,  where  a  is  the  exponent  of 
the  power  law.  For  FBM,  this  exponent  is  limited  to  the  open  interval 
(-3,-1);  for  FGN,  it  is  limited  to  (-1,1).  Neither  process  actually 
includes  the  case  a  =  -1.  Interestingly  enough,  this  exceptional  case 
seems  to  occur  quite  often  in  practical  applications  [BLW94]  and  is 
refered  to  in  the  literature  as  (pure)  1//  noise,  pink  noise  and  flicker 
noise.  An  FD  process  is  also  a  stochastic  power  law  process,  but  its 
exponent  can  assume  any  real- value,  including  the  important  case 
a  =  —1. 

•  Model  continuity.  While  practitioners  have  been  tempted  to  group 
FBM  and  FGN  processes  together  in  an  attempt  to  obtain  coverage 
of  power  laws  ranging  from  —S  up  to  1,  the  FGN  and  FBM  processes 
do  not  smoothly  transition  into  one  another  at  the  a  =  —  1  boundary 
due  to  a  discontinity  in  their  SDFs  at  high  frequencies.  This  discon¬ 
tinuity  can  lead  to  subtle  problems  in  model  selection.  FD  processes 
have  no  such  discontinuity.  In  addition,  an  FD  process  is  closed  un¬ 
der  differencing  operations;  i.e.,  if  {Xt\  is  an  FD  process  and  if  we 
define  Yt-Xt-  Xt-u  then  the  process  {Yt}  is  also  an  FD  process. 
By  contrast,  differencing  an  FGN  or  FBM  process  will  not  yield  the 
same  type  of  process.  Because  differencing  plays  such  a  prominent 
role  in  time  series  analysis,  FD  processes  are  thus  more  flexible  and 
tractable  as  models. 

•  Tractable  Time  and  Frequency  Domain  Characterizations. 
In  contrast  to  FBM  and  FGN  processes,  an  FD  process  has  simple 
expressions  for  both  its  SDF  and  (when  stationary)  its  autocovari¬ 
ance  sequence  (AC VS).  This  means  that  both  the  SDF  and  ACVS 
of  the  FD  processes  can  manipulated  analytically  and  also  readily 
computed  without  having  to  approximate  any  infinite  summations 
(as  occurs  in  the  expression  for  the  SDF  for  FGN). 

•  Model  flexibility.  Both  autoregressive  and  moving  average  com¬ 
ponents  can  be  added  to  an  FD  process  to  provide  additional  model¬ 
ing  flexibility,  leading  to  the  well-known  class  of  autoregressive,  frac¬ 
tionally  integrated,  moving  average  (ARFIMA)  models  [Ber94].  This 
flexibility  is  sometimes  needed  to  model  the  high  frequency  content 
of  measured  data,  which  is  often  contaminated  by  exogenous  noise 
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sources.  Similar  extensions  could  be  made  to  FBM  and  FGN  pro¬ 
cesses,  but  such  additions  would  further  complicate  their  SDFs  and 
ACVSs. 

In  the  remainder  of  this  chapter,  we  first  give  a  definition  for  FD  processes 
(§5.1)  and  then  describe  wavelet-based  schemes  for  estimating  the  parame¬ 
ters  of  this  process  in  a  flexible  manner  (for  further  details,  see  Chapters  7 
and  9  of  Percival  and  Walden,  2000,  and  Constantine  et  al  [CPROl],  upon 
which  the  material  that  follows  is  based). 


5.1  Definition  of  a  Fractionally  Differenced  Process 


The  easiest  way  to  define  an  FD  process  is  via  its  SDF.  Let  5  be  any  real- 
valued  number,  let  <7^  >  0,  and  let  Z  denote  the  set  of  all  integers.  The 
stochastic  process  {Xt^t  G  Z}  is  called  an  FD((5, a^)  process  if  it  possesses 
an  SDF  given  by 


An  FD  process  thus  depends  on  two  parameters.  The  first,  is  called  the 
fractionally  differenced  parameter  and  determines  the  shape  of  the  SDF; 
the  second,  cr^,  is  called  the  innovations  variance  and  sets  the  level  (height) 
of  the  SDF.  When  5  <  1/2,  an  FD  process  is  stationary  and  has  an  ACVS 
{sx.t^t  ^  can  be  conveniently  obtained  by  first  computing 


sx,o  =  var  {A't}  — 


a2r(l  -  2(5) 
r2(l-(5)  ’ 


where  T{')  is  Euler’s  gamma  function  [AS64],  and  then  recursively  using 

the  formula  _  . 

r  -h  (5  -  1 

for  r  =  1,2,...  (this  also  gives  us  the  values  of  sx.r  when  r  <  0  since 
sx^r  =  -r)*  When  (5  >  1/2,  we  obtain  a  class  of  nonstationary  processes 

that  are  stationary  if  {A’f }  is  differenced  d  =  [5  -h  1/2J  times,  where  [xj  is 
the  greatest  integer  less  than  or  equal  to  x;  i.e.,  while  {Xt}  is  nonstationary, 
the  process 

k^o  ^  ^ 

is  stationary  (thus  Yt  =  Xt  ~  when  d  =  I,  Yt  =  Xt  —  2Xt-i  + 
Xt-2  when  d  =  2,  and  so  forth).  If  we  use  the  small  angle  approximation 
sin(x)  «  X,  we  see  from  Equation  (5.1)  that  the  SDF  for  an  FD((5,  (t|) 
process  approximately  obeys  a  power  law  process,  i.e.,  Sx{f)  ^  l/l^i 
low  frequencies  with  a  =  -2S  (the  error  in  this  approximation  is  quite 
small  for  |/1  <  1/8). 
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5.2  Wavelet-Based  Estimation  of  FD  Parameters 

Suppose  that  we  have  a  time  series  that  can  be  regarded  as  a  realization 
of  a  portion  X  =  [Xq,  , . . . ,  Xn-^iV  of  an  FD((5,  process,  where  6  is 
presumed  to  be  unknown  and  is  to  be  estimated  from  the  time  series.  If 
the  FD  process  is  Gaussian,  then  arguably  the  best  estimator  for  6  is  the 
maximum  likelihood  estimator  (MLE);  however,  this  estimator  can  be  very 
difficult  to  compute  even  for  moderate  sample  sizes  [Ber94],  Here  we  con¬ 
sider  three  computationally  efficient  schemes  for  estimating  the  parameter 
6  via  a  wavelet  transform  of  the  time  series.  The  first  two  schemes  make  use 
of  the  fact  that  the  relationship  between  the  variance  of  the  wavelet  coeffi¬ 
cients  across  scales  is  dictated  by  6  in  such  a  manner  that  we  can  construct 
a  least  squares  estimator  (LSE)  of  S  (Abry  et  al  [AGF93,  AG95],  Abry  and 
Veitch  [AV98]  and  Jensen  [Jen99b]  consider  similar  estimators).  The  third 
scheme  is  a  wavelet-based  approximation  to  the  MLE  of  5  (Wornell  and 
Oppenheim  [W092],  Wornell  [Wor93,  Wor96],  Kaplan  and  Kuo  [Kap93], 
McCoy  and  Walden  [MW96]  and  Jensen  [Jen99a,  JenOO]  discuss  related 
wavelet-based  MLEs).  The  first  LSE  and  the  MLE  make  use  of  the  entire 
time  series  and  hence  are  called  ‘block  dependent’  estimators;  by  contrast, 
the  second  LSE  utilizes  only  certain  coefficients  that  are  colocated  in  time, 
and  we  refer  to  it  as  an  ‘instantaneous’  estimator. 

5,2,1  Block  dependent  FD  model  parameter  estimators 

Block  Dependent  Weighted  Least  Squares  Estimator 

Let  dj  be  a  vector  of  length  N  containing  the  MODWT  wavelet  coefficients 
for  scale  tj.  Here  we  develop  a  weighted  LSE  (WLSE)  of  S  based  upon  an 
estimator  of  the  variance  of  the  nonboundary  (interior)  coefficients  in  dr¬ 
over  a  range  of  scales  tj  given  hy  Jq  <  j  <  Ji  (the  selection  of  Jq  and  Ji 
is  application  dependent).  Under  the  assumption  that  the  length  L  of  the 
wavelet  filter  is  chosen  such  that  L/2  >  these  nonboundary  coef¬ 

ficients  are  a  portion  of  a  stationary  process  obtained  by  filtering  the  time 
series  with  the  equivalent  MODWT  wavelet  filter  hjj.  Since  the  squared 
gain  function  for  hjj  is  given  by  'Hj,l(/),  the  SDF  for  the  nonboundary 
coefficients  is  given  by  Sx{f)y  ^'^d  hence  their  variance  can  be 

expressed  as 

=  var{Wj,t}  =  /  UjM  ^xU)  df.  (5.2) 

J-1/2 

Using  the  approximation  that  Hj^Lif)  is  an  ideal  bandpass  filter  over  |/|  £ 
[l/2^'+\l/2-’]  and  taking  into  consideration  the  even  symmetry  of  SDFs, 
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an  approximation  to  the  wavelet  variance  is  given  by 

ri/2^' 

/ 1  /2J 

For  FD  processes,  we  have 


r\/V 

^  2  /  Sx{f)  df. 

7i/2J  +  i 


rl/2^ 


df. 


(5.3) 


(5.4) 


/i/2,+i  1 2  sin  (tt/)  P'5 

When  j  >  3,  so  that  sirntf  w  tt/,  Equation  (5.4)  can  be  approximated  by 

I'xiTj)  «  (^e  c(<J)  (5-5) 


where  c((5)  =  Equation  (5.5)  suggests  that  a  direct 

means  of  estimating  6  is  to  fit  a  least  squares  line  to  the  logarithm  of  an 
estimate  of  the  wavelet  variance,  say  Oxi^j).  The  slope  of  the  line,  say  /3, 
that  best  fits  ln(i>^(rj))  versus  In(Tj)  in  a  least  squares  sense  is  related 
to  the  FD  parameter  by  J  =  (^3  +  l)/2  and  the  power  law  exponent  by 
a  =  "b  !)• 

Given  a  time  series  of  length  N,  we  can  obtain  an  unbiased  MODWT- 
based  estimate  of  the  wavelet  variance  by  defining 


'"x(T7) 


1 

Wj 


N-1 

E 


dlt, 


(5.6) 


where  Mj  =  N  -  Lj  +  1  is  the  number  of  MODWT  nonboundary  wavelet 
coefficients.  As  a  caveat,  it  should  be  noted  that  the  wavelet  variance  es¬ 
timates  are  somewhat  sensitive  to  the  order  L  of  the  wavelet  filter  used  in 
the  analysis.  In  particular,  there  can  be  a  significant  bias  in  estimating  S 
(and  hence  a)  if  we  use  the  Haar  wavelet  filter  (for  which  L  =  2)  [PWOO]. 
This  bias  can  be  attributed  to  a  spectral  leakage  phenomenon  and  can  be 
attenuated  by  increasing  L.  In  practice  the  choice  L  =  8  often  works  well. 

As  discussed  in  §4.3,  the  distribution  for  i>^(rj)  is  approximately  that  of 
a  random  variable  (RV)  given  by  '^'^here  i®  ^  chi-square 

RV  with  Tjj  degrees  of  freedom.  Define 

n^,)  =  ln(fi(r,))-^(|)+ln(|).  (W) 

where  i/>(  )  is  the  digamma  function.  The  properties  of  the  chi-square  dis- 
tribution  dictate  that 

E{Y{rj)}  =:  ln(i/^(rj))  and  var{y(rj)}  =  '0'(??i/2),  (5.8) 

where  ?/;'(■)  is  the  trigamma  function.  By  assuming  the  approximation  af¬ 
forded  by  Equation  (5.5),  we  can  now  formulate  a  linear  regression  model 
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Y{Tj)  =  7-1- /31n(rj)-t-e;,  where  Cj  =  ln(i>^(Tj)/i/^(rj))-V'(»7i/2)+ln(7j_,/2) 
defines  a  sequence  of  errors,  each  with  zero  mean  and  variance  ■ip'{T]jl2).  If 
we  take  into  account  the  inhomogeneity  in  the  variance  in  these  errors,  we 
arrive  at  the  WLSE  of  the  slope  term  0  given  by 

a  E  E  ln(ri)r(r,)  -  ln(r,) 

0.ise- 

where  Wj  =  [ip'  {T]j  /2)]  “  ^  and  all  sums  are  over  j  =  Jq,.  ■ .  ,JiThe  weighted 
least  squares  estimate  of  the  FD  parameter  is  then 

Swlse  =  -^{Pwlse  +  !)•  (5.10) 

If  we  ignore  the  possible  correlation  between  the  error  terms  (which  we  can 
decrease  by  increasing  L),  the  variance  of  0wiae  is  given  by 


var{y3u,/se} 


E^^j 

i:a;,i:‘^iln2(r,)-(Ea;iln(r,))2’ 

(5.11) 


and  thus  the  variance  of  the  S^ise  is  given  by 

var{Jt„(se}  =  ^var{^u,jse}-  (5-12) 

Monte  Carlo  studies  indicate  that  Equation  5.11  tends  to  overestimate  the 
variability  in  0uiise  somewhat  and  thus  can  be  regarded  as  a  conservative 
upper  bound  [PWOO]. 

Block  Dependent  Maximum  Likelihood  Estimator 

Wavelet-based  maximum  likelihood  techniques  can  be  used  in  harmony 
with  an  FD  model  as  another  means  of  obtaining  estimates  for  FD  param¬ 
eters.  Using  the  DWT  is  advantageous  in  that  it  is  known  to  decorrelate 
long  memory  FD  and  related  processes,  forming  a  near  independent  Gaus¬ 
sian  sequence,  and  thus  simplifying  the  statistics  significantly  [CPGOOa]. 
The  basic  idea  is  to  formulate  the  likelihood  function  for  the  FD  param¬ 
eters  S  and  cTj  directly  in  terms  of  the  interior  DWT  wavelet  coefficients. 
Let  dr  be  an  M  =  Ej  vector  containing  all  of  the  interior  DWT 

wavelet  coefficients  over  a  specified  range  of  scales  j  =  Jo, . . . ,  Ji.  We  can 
write  the  exact  likelihood  function  for  5  and  as 

-dfE2;d,/2 

A<5,o-£|d/)=  (27r)*^/2|Sd,|i/2’ 

where  Ed,  is  the  covariance  matrix  of  d/,  and  |Ed,|  is  the  determinant  of 
Ed, .  Note  that  the  dependence  of  the  likelihood  function  on  6  and  is 
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through  Ed/  alone.  Under  the  assumption  that  the  wavelet  coefficients  in 
d/  are  approximately  uncorrelated,  Equation  5.13  can  be  approximated  by 


ji  Mj-i 

#— n  (27rC,(<5,a2))i/2  ’ 


j=Jo  t=0 


where  CjiS.a'^)  is  an  approximation  to  the  variance  of  dj^t  given  by  the 
average  value  of  the  SDF  in  Equation  5.1  over  the  nominal  pass-band 
[l/4rj, l/2rj]  for  the  equivalent  wavelet  filter  hj^i.  The  estimate  Smie  of 
S  is  obtained  by  maximizing  C{S,(T^\dj)  with  respect  to  S.  Equivalently  we 
can  consider  the  reduced  (natural)  log  likelihood  function 


l{6\di)  =  M\n{ali5))  +  Mj  ln((7j((5)), 
j=Jo 


where  Cj{5)  =  Cj{S,a‘^)la^£,  and 


1 

»?(«')  ^  S  E  ^  E  4.«;- 

j  =  Jo  j  t— u 


(see  [PWOO]  for  explicit  details  on  the  development  of  the  reduced  (natu¬ 
ral)  log  likelihood  function  using  the  DWT  coefficients).  Minimizing  Equa¬ 
tion  (5.15),  which  is  a  function  of  <5  alone,  yields  the  maximum  likelihood 
estimate  Smte,  after  which  we  can  compute  the  corresponding  estimate  for 
cr|  by  plugging  SmU  into  Equation  5.16. 

Under  the  assumption  that  <5  €  [-1/2,  L/2],  the  estimator  S^ie  for  large 
M  is  approximately  Gaussian  distributed  with  mean  S  and  variance 


where 


<t>j  = 


var{dj,t} 

2i+2 

'CjiLte) 


\  IL  .(f>(2sin(7r/)) 
_  ln(2sin(7r/)) 

(e)A/4r,  [2sin(7r/)]2'5m/. 


(see  [CPGOOb]  for  details).  In  practice,  the  right-hand  integral  can  be  ap¬ 
proximated  through  either  (i)  numerical  integration  or  (ii)  a  Taylor  series 
expansion  about  the  mid-band  frequencies  for  levels  j  —  1,2  along  with 
direct  integration  using  a  small  angle  assumption  for  j  >  2.  The  approxi¬ 
mation  above  is  based  upon  the  view  that  the  wavelet  transform  forms  an 
octave  band  decomposition.  There  is  generally  a  large  increase  in  computa¬ 
tional  speed  when  using  this  bandpass  approximation  with  relatively  small 
loss  of  accuracy. 
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5.2,2  Instantaneous  FD  model  parameter  estimators 

The  block  dependent  estimators  we  formulated  in  5.2.1  depend  upon  the 
entire  time  series  Xq,  . . . ,  Xtv-i.  For  time  series  whose  statistical  properties 
are  evidently  evolving  over  time,  the  assumptions  behind  this  estimator 
are  violated,  and  it  is  problematic  to  use  this  estimator  on  the  entire  times 
series.  If,  however,  we  can  divide  the  time  series  up  into  blocks  within 
which  we  can  assume  that  the  data  are  the  realization  of  an  FD  process 
(with  parameters  that  are  now  allowed  to  vary  from  one  block  to  the  next), 
we  can  apply  the  WLSE  estimator  on  a  block  by  block  basis.  In  practice, 
each  of  the  blocks  will  contain  the  same  number  of  points,  so  we  can  now 
consider  N  to  be  the  size  of  each  block  rather  than  the  length  of  the  entire 
time  series.  The  choice  of  N  is  usually  subjective  and  thus  open  to  question, 
so  it  is  useful  to  have  some  means  of  verifying  that  a  particular  choice  is 
appropriate.  We  can  do  so  by  formulating  an  instantaneous  estimator 
that  is  independent  of  N  and  that  can  be  used  to  check  for  departures 
from  statistical  consistency  within  a  proposed  block  size. 

Instantaneous  Least  Squares  Estimator 

The  idea  behind  an  instantaneous  least  squares  estimate  of  <5  is  to  use  only  a 
single  wavelet  coefficient  from  each  scale;  i.e.,  we  only  use  to  estimate 
i/^(rj),  where  tj  is  the  time  index  of  the  level  MODWT  coefficient 
associated  with  time  t  in  time  index  tj  can  be  meaningfully 

determined  only  if  (approximate)  linear  phase  wavelet  filters  are  used.  With 
this  substitution,  the  time  dependent  form  of  Equation  (5.10)  becomes 

(5.19) 


where  A j  -  Ji  -  Jo  +  1  and  all  sums  are  over  i  =  Jo,  •  •  • ,  Ji  and 

Ytirj)  =  ln(j|,.)  t/^(l/2)  -  ln(2).  (5,20) 

To  decrease  the  variability  of  the  estimates  Aj  should  ideally  be  set  to  be 
2is  large  as  is  feasible. 

Instantaneous  Maximum  Likelihood  Estimator 

To  form  an  instantaneous  maximum  likelihood  estimator,  we  alter  slightly 
the  block  dependent  reduced  log  likelihood  function  (Equation  5.15)  so  that 
(only)  a  single  interior  wavelet  coefficient  is  used  at  each  scale: 

Ji 

f((5|d/)  =  Ajln(aj(<5))  +  ^  ln(C';((5)), 

j=Jo 


(5.21) 
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where  C'(<5)  =  and 


{S) 


1  •'* 


1 


j=Jo 


Jl 

c'(<)S4- 


(5.22) 


where  tj  is  the  level  (zero  phase  shifted)  MODWT  coefficient  that  is 
associated  with  time  t  and  Aj  =  Ji  —  Jo  +  1  is  the  number  of  interior 
MODWT  coefficients  at  time  tj  (assuming  Jo  <  Ji  and  that  level  Jo  con¬ 
tains  at  least  one  interior  wavelet  coefficient  at  time  tj). 


5,2.3  The  WaveletFDP  Object 

The  wavFDPBlock  and  wavFDPTime  functions  estimate  the  block  depen¬ 
dent  and  instantaneous  FD  process  model  parameters,  respectively,  of  a 
real- valued  uniformly-sampled  time  series  and  each  returns  an  object  of 
class  WaveletFDP.  Several  methods  are  available  to  the  user  to  view,  sum¬ 
marize,  and  access  the  data  contained  in  a  WaveletFDP  object: 

Summary  Operator  Methods: 


print  Prints  useful  information  regarding  the  FD  model  pa¬ 

rameter  estimation  including: 

•  A  summary  of  the  estimated  FD  parameters: 
var{J},  and  a^. 

•  The  method  used  to  estimate  the  FD  process 
model  parameters. 

•  Information  regarding  the  handling  of  boundary 
coefficients. 

•  Decomposition  levels  over  which  the  estimates 
were  calculated. 

•  The  search  range  of  the  FD  parameter  {S). 

•  Information  regarding  the  wavelet  transform  fil¬ 
ters. 

plot  Plots  the  estimates  FD  parameter  6t.  For  instanta¬ 

neous  LSEs,  an  optional  numeric  constant  can  be  used 
as  a  second  argument  to  the  plot  function  in  order  to 
display  the  confidence  intervals  about  a  known  value 
of  the  FD  parameter  S.  This  method  is  only  applicable 
for  instantaneous  estimates  produced  by  the  wavFDP¬ 
Time  function. 
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Data  Access  Methods 

$  Use  to  access  specific  fields  of  the  class  object.  A  list 

of  accessible  fields  can  be  generated  using  the  names 
function. 

An  example:  FD  parameter  estimation  of  a  simulated 
FD  realization 

Consider  the  512  point  FD(0.45, 1.0)  realization: 

>  plot(  fdp045,  type  =  "1“  ) 


FIGURE  5.1.  A  512  point  realization  of  a  FD  process  whose  model  parameters 
axe  constant;  <5  =  0.45,  cr^  =  1.0. 

Figure  5.1  shows  the  time  history  of  the  FD  realization.  Since  we  know  the 
true  values  of  the  FD  model  parameters,  we  can  scrutinize  the  accuracy 
of  block  dependent  and  instantaneous  estimators.  Let  us  first  examine  the 
block  dependent  estimators.  To  perform  a  weighted  least  squares  estimation 
we  use  the  wavFDPBIock  command  as  follows: 
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>  wavFDPBlockC  fdp045,  lev=l:6,  est="wlse", 

+  boundary='*unbiased*' ,  edof=l  ) 

Block-dependent  FD  parameter  estimation  of  fdp045 

FD  parameter  estimate  (delta):  0.37451 

vaxdelta  estimate:  0.00121 

Innovations  variance  estimate:  NA 

Estimator:  WLSE 

Levels:  123456 

Boundary  mode :  unbiased 

EDOF  mode :  1 

Delta  range:  -10  10 

Wavelet :  s8 

Length  of  series:  512 

Number  of  levels :  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

We  see  that  the  unbiased  WLSE  of  delta  is  close  to  the  known  value  of 
0.45.  But  perhaps  we  could  do  better  with  the  biased  WLSE,  this  time 
over  levels  2  —  6: 

>  wavFDPBlockC  fdp045,  lev=2:6,  est='’wlse'’ , 

+  boundary='’biased"  ) 

Block-dependent  FD  parameter  estimation  of  fdp045 

FD  parameter  estimate  (delta):  0.4432 

vaxdelta  estimate:  0.00206 

Innovations  variance  estimate:  NA 

Estimator:  WLSE 

Levels:  23456 

Boundary  mode:  biased 

EDOF  mode :  1 

Delta  range:  -10  10 

Wavelet:  s8 

Length  of  series:  512 

Number  of  levels:  5 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 
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Here,  the  biased  WLSE  does  much  better  job  than  the  unbiased  case.  Now 
we  examine  the  blocked  MLE  technique  using  a  stationary  FD  model.  Un¬ 
der  a  stationary  model,  the  FD  parameter  is  assumed  to  be  in  the  stationary 
regime,  i.e.  6  <  0.5  which  (in  this  case)  we  know  to  be  true: 

>  wavFDPBlockC  fdp045,  lev=l:6,  est="mle”, 

+  boundary=”stationary"  ) 

Block-dependent  FD  parameter  estimation  of  fdp045 

FD  parameter  estimate  (delta):  0.46502 
vardelta  estimate:  NA 
Innovations  variance  estimate:  1.07116 
Estimator:  MLE 
Levels:  123456 

Boundary  mode:  stationary  FD  process  model 

Delta  range:  -10  10 

Wavelet :  s8 

Length  of  series:  512 

N\imber  of  levels :  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

The  MLE  using  a  stationary  model  does  an  excellent  job  in  estimating 
model  parameters.  For  the  general  case,  however,  we  will  not  know  the 
value  of  <5  a  priori.  In  that  case,  let  us  use  the  stationary-nonstationary  FD 
model  which  carries  no  restriction  on  the  value  of  6: 
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>  wavFDPBlockC  fdp045,  lev=l:6,  est="mle”, 

+  boundary= "nonstationary"  ) 

Block-dependent  FD  parameter  estimation  of  fdp045 

FD  parameter  estimate  (delta):  0.4459 
vardelta  estimate:  NA 
Innovations  variance  estimate:  1.0846 
Estimator:  MLE 
Levels:  123456 

Boundary  mode:  stationary-nonstationary  FD  process  model 

Delta  range:  -10  10 

Wavelet :  s8 

Length  of  series:  512 

Number  of  levels:  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

The  result  indicates  that  the  stationary-nonstationary  model  also  does  an 
excellent  job  in  estimating  the  FD  model  parameters. 

Now  we  turn  our  attention  to  the  instantaneous  methods.  We  perform 
biased  and  unbiased  instantaneous  least  squares  estimates  as  follows: 

>  wavFDPTimeC  fdp045,  lev=l:6,  est="lse",  biased=T  ) 

Instantaneous  FD  parameter  estimation  of  fdp045 

Mean  of  FD  parameter  estimates  (deltas):  0.45679 

Mean  of  vardelta  estimates:  0.14673 

Mean  of  innovations  variance  estimates:  NA 

Estimator:  LSE 

Levels:  123456 

Boundeiry  mode:  biased 

Chi-squared  DOF :  1 

Delta  range:  -10  10 

Wavelet :  s8 

Length  of  series:  512 

Number  of  levels:  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 
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>  Ise. unbiased  <-  wavFDPTime(  fdp045,  lev-liS,  est-’'lse", 

+  biased=F  ) 

>  Ise. unbiased 

Instantaneous  FD  parameter  estimation  of  fdp045 

Mean  of  FD  parameter  estimates  (deltas);  0.36536 

Mean  of  vardelta  estimates:  0.6948 

Mean  of  innovations  variance  estimates:  NA 

Estimator:  LSE 

Levels:  123456 

Boundary  mode:  unbiased 

Chi-squared  DOF:  1 

Delta  range:  -10  10 

Wavelet:  s8 

Length  of  series:  512 

Number  of  levels:  6 

Boundary  correction  rule:  periodic 

Filtering  technique:  convolution 

To  plot  the  results  we  invoke  the  plot  method: 

>  plot(  Ise. unbiased  ) 

Figure  5.2  shows  the  result.  The  shaded  areas  about  the  estimates  are  the 
95%  confidence  intervals  based  on  chi-square  distribution  assumption  on 
the  interior  wavelet  coefficients.  Since  we  know  the  true  value  of  5  we  can 
force  the  confidence  intervals  to  be  centered  about  <5  =  0.45: 

>  plot(  Ise. unbiased,  mean. delta  =  0.45  ) 

Figure  5.3  shows  that  the  instantaneous  LSE  do  a  good  job  in  estimat¬ 
ing  the  true  value  of  the  time  series  with  the  exception  of  the  endpoints 
which  are  more  variable  due  to  a  lesser  number  of  degrees  of  freedom.  The 
endpoints  of  the  MODWT  has  fewer  interior  wavelet  coefficients  at  a  par¬ 
ticular  time  than  do  the  points  located  more  towards  the  middle  of  the 
sequence.  This  is  and  unavoidable  and  so  we  expect  more  variability  near 
the  endpoints. 

The  instantaneous  estimators  are  inherently  more  variable  than  the  blocked 
estimators.  However,  we  can  smooth  out  the  instantaneous  estimates  by  us¬ 
ing  more  degrees  of  freedom  in  the  estimates.  What  we  are  doing  here  is 
to  average  the  energy  of  the  MODWT  coefficients  around  a  given  point 
in  time,  using  multiple  points  instead  on  one.  The  more  points  that  we 
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Instantaneous  FD  parameter  estimation  of  fdp045 


FIGURE  5.2.  Unbiased  instantaneous  FD  parameter  estimation  of  a  FD(  0.45, 
1.0  )  process.  The  95%  confidence  intervals  are  displayed  as  the  shaded  covering 
the  estimates. 
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FIGURE  5.3.  Unbiased  instantaneous  FD  parameter  estimation  of  a  FD(  0.45, 
1.0  )  process.  The  95%  confidence  intervals  are  displayed  as  the  shaded  covering 
the  estimates  based  on  the  known  value  of  J  =  0.45. 
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use,  the  smoother  the  estimates  at  the  price  of  being  less  localized  in  time. 
These  estimates  are  known  as  localized  estimates  and  lie  somewhere  be¬ 
tween  instantaneous  and  block  dependent  estimators.  To  illustrate,  let  us 
develop  localized  MLEs  of  the  fdp045  sequence  with  increasing  DOFs: 

>  dofs  <“  0:3 

>  deltas  <“  lapply(dofs,functioii(i) 

+  wavFDPTime(fdp045,  lev=l:6,  est="lse‘',  dof=i  )$delta  ) 

>  namesC  deltas  )  <~  paste(2*(dof s)+l , "DOF") 

>  stack.plot(  deltas,  same. scale  =  T,  2eroline=T  ) 


1  DOF 


3  DOF 


5  DOF 


7  DOF 
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FIGURE  5.4.  Localized  instantaneous  least  squares  estimates  of  the  fdp045  se¬ 
quence  using  (from  top  to  bottom)  1,3,5,  and  7  chi-square  degrees  of  freedom. 

Figure  5.4  shows  the  effects  of  the  local  smoothing  on  the  instantaneous  FD 
parameter  estimates.  The  DOFs  are  increased  through  the  dof  argument 
of  the  wavFDPTime  function,  where  dof  represents  the  DOF  order,  K.  The 
number  of  degrees  of  freedom  is  equal  to  2  x  RT  -F  1)  so  the  DOFs  used  in 
Fig,  5.4  (from  top  to  bottom)  are  1,3,5,  and  7,  respectively.  The  sample 
mean  and  variance  of  localized  LSE  of  J  are  calculated  via: 
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>  lapply(  deltas,  .function(x)  mean(x,na.nn=T)  ) 

$"1  DOF": 

[1]  0.3653601 

$"3  DOF": 

[1]  0.4133021 

$"5  DOF": 

[1]  0.3936822 

$"7  DOF": 

[1]  0.3770256 

>  lapply(  deltas,  function(x)  var(x,na.method="omit")  ) 

$"1  DOF": 

[1]  0.8556084 

$"3  DOF": 

[1]  0.1669712 

$"5  DOF": 

[1]  0.09127696 

$"7  DOF": 

[1]  0.06862063 

We  see  that  the  variance  of  the  estimates  goes  down  with  an  increase  in 
DOF  order,  but  at  the  cost  of  introducing  more  bias  in  the  mean  of  the 
estimates.  A  similar  effort  using  a  maximum  likelihood  estimator  shows 
the  sample  mean  and  variance  trends,  but  the  bias  between  the  true  and 
estimated  values  of  S  is  less  than  that  of  the  LSE: 
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>  deltas  <-  lapply(dofs,fuiiction(i) 

+  wavFDPTime(fdp045,  lev=l:6,  est="inle",  dof=i  )$delta  ) 

>  naines(  deltas  )  <-  paste(2*(dofs)+l,"D0F") 

>  lapply(  deltas,  function(x)  meaii(x,iia.rm=T)  ) 

$"1  DOF"; 

[1]  0.3729772 


$"3  DOF": 

[1]  0.4416434 


$"5  DOF": 

[1]  0.4325607 


$"7  DOF": 

[1]  0.4151354 

>  lapplyC  deltas,  function(x)  var (x,na.method="omit")  ) 
$"1  DOF": 

[1]  1.022432 

$"3  DOF": 

[1]  0.2421365 

$"5  DOF": 

[1]  0.124924 

$"7  DOF": 

[1]  0.09654555 


5.2.5  Example:  analysis  of  aerothermal  turbulence  data 

To  demonstrate  the  potential  of  the  S-l- Wavelets  module,  we  examine  block 
dependent  and  instantaneous  estimates  of  a  7.5  million  point  aerothermal 
turbulence  sequence  known  as  the  aero  series  (see  [CPROl]  for  details).  Due 
to  the  large  amount  of  data,  a  MA{q,r)  filters  (moving  average  using  win¬ 
dows  of  length  q  with  an  overlap  of  r  points)  was  used  for  purposes  of  display 
and  comparison  of  results.  Figure  5.5  shows  the  aero  series  smoothed  with 
a  MA(10000,0)  filter.  Typical  of  turbulence  data,  the  aero  series  exhibits 
seemingly  random  fluctuations  at  various  scales  and  times. 

The  goal  of  the  research  was  to  quantify  these  random  fluctuations  as  a 
function  of  space  and  scale  using  block  dependent  FD  parameter  estimators. 
A  secondary  goal  was  to  quantify  the  departure  of  the  FD  parameter  (5) 
estimates  from  the  theoretical  Kolmogorov  turbulence  value  of  5  =  5/6. 
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FIGURE  5.5.  Aerothermal  turbulence  series. 


Figure  5,6  shows  such  a  departure  via  (smoothed)  WLSE  of  S  over  scales 
tq-ts  and  rg-rn  (here  the  data  is  plotted  as  the  spectral  density  function 
(SDF)  power  law  exponent  a  which  is  related  to  the  FD  parameter  by 
a  =  -2S).  Note  the  apparent  wide  range  of  and  which  roughly 
span  values  appropriate  for  stationary  white  noise  up  to  nonstationary 
random  walk  noise. 

The  results  clearly  suggests  that  a  single  (Kolmogorov)  exponent  is  not 
an  adequate  description  of  this  aerothermal  turbulence  data  as  might  be 
incorrectly  construed  from  conventional  Fourier-based  methods.  Conven¬ 
tionally,  for  example,  the  SDF  power  law  exponents  are  estimated  directly 
from  an  estimate  of  the  SDF  for  the  data.  For  example,  the  slope  of  the 
SDF  on  a  log-log  scale  provides  a  direct  estimate  of  a.  Figure  5.7  shows 
the  SDF  of  the  entire  aero  series,  computed  by  partitioning  the  aero  se¬ 
ries  into  2^®  point  blocks,  forming  a  spectral  estimate  for  each  block  and 
then  averaging  the  spectral  estimates  together.  The  average  SDF  portrays  a 
strong  Kolmogorov  turbulence  slope  of  a  «  -5/3  over  many  octaves.  This 
global  approach  masks  the  fact  that  there  are  significant  deviations  from 
the  -5/3  law  locally  in  time  and  hence  does  not  accurately  portray  the 
dynamics  of  a.  We  could,  of  course,  track  the  power  law  estimate  of  each 
block  as  time  unfolds,  but  we  would  then  need  some  scheme  for  partition¬ 
ing  the  frequencies  into  regions  over  which  a  single  power  law  is  applicable. 
If  we  use  a  partitioning  scheme  that  is  essentially  the  same  as  what  our 
wavelet  methodology  yields,  the  work  of  McCoy  et  al  [MW96]  shows  that 
wavelet-based  estimates  of  a  have  better  mean  square  error  properties  than 
do  those  based  upon  the  SDF. 


5.3  Time- Varying  FD  Process  Simulation 

Time- varying  fractionally  differenced  (TVFD)  processes  can  serve  as  useful 
models  for  certain  time  series  whose  statistical  properties  evolve  over  time. 
The  spectral  density  function  for  a  TVFD  process  obeys  a  power  law  whose 
exponent  can  be  time  dependent.  In  contrast  to  locally  stationary  or  locally 
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Time  (min) 


FIGURE  5.6.  Block-dependent  weighted  least  squares  estimates  of  the  FD  pa¬ 
rameter  (S)  for  the  aero  series.  The  <5  estimates  are  smooth  with  a  moving  average 
filter  and  mapped  to  the  SDF  exponent  a  using  the  relation  a  =  —25.  The  esti¬ 
mates  are  performed  over  scales  re  —  rs  and  rg  —  th. 
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FIGURE  5.7.  Averaged  estimated  SDF  for  aero  series  and  the  theoretical  SDFs 
for  an  FD  process  and  pure  power  law  (PPL)  model  of  fully  developed  Kol¬ 
mogorov  turbulence  with  an  infinite  inertial  range.  The  FDP  and  PPL  curves  are 
purposefully  offset  from  the  average  SDF  of  aero  series  so  that  their  In-ln  SDF 
slopes  may  be  easily  compared  over  a  broad  range  of  scale.  The  vertical  divisions 
represent  the  octaves  over  which  the  wavelet  coefficients  at  scale  tj  are  nominally 
associated. 
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self-similar  processes,  the  power  law  exponent  for  a  TVFD  process  is  not 
restricted  to  certain  intervals,  which  is  of  practical  importance  for  modeling 
time  series  of,  e.g.,  atmospheric  turbulence. 

It  is  possible  to  produce  exact  realizations  of  Gaussian  TVFD  processes 
(whose  parameters  fluctuate  in  an  arbitrary  manner)  using  either  a  modi¬ 
fied  Cholesky  decomposition  or  a  circulant  embedding  scheme  [PC02].  Use 
of  these  exact  methods  ensures  that  Monte  Carlo  studies  of  the  statistical 
properties  of  estimators  for  TVFD  processes  are  not  adversely  influenced 
by  imperfections  arising  from  the  use  of  approximate  simulation  methods. 
Using  the  wavFDPSimulate  function,  you  can  generate  finite  length  real¬ 
izations  of  a  TVFD  process.  For  example,  suppose  we  wish  to  emulate  the 
dynamics  of  the  aerothermal  turbulence  sequence  shown  in  Fig.  5.5  using  a 
multi-linear  approximation  to  the  WLSE  of  6  (Fig.  5.6)  for  scales  re  —  rg: 

>  delta  <-  c(rep(l/4,100) ,seq(l/4,5/6,len=40) ,rep(5/6,410) , 

+  seq(5/6,0,len=100) ,seq(0, 1/2, len=374)) 

>  innov  <-  rep(l , length (delta) ) 

>  tvfd  <-  wavFDPSimulate (  delta=delta,  innov  =  innov  ) 

>.par(  mfrow=c(2,l)  ) 

>  plot(  delta,  type='’l"  ) 

>  plot(  tvfd,  type="l*'  ) 

The  piecewise  linear  approximation  of  the  aerothermal  WLSE  of  St  starts 
out  in  the  stationary  region  (<5  <  0.5),  then  evolves  into  a  nonstationary 
region  which  is  intended  to  mimic  Kolmogorov  turbulence  (S  =  5/6),  fol¬ 
lowed  by  a  return  to  a  stationary  region.  Although  St  fluctuates  greatly,  the 
resulting  TVFD  is  smooth  in  the  transitional  regions  of  5.  This  smooth  tran¬ 
sitional  behavior  coupled  with  the  knowledge  that  the  underlying  method¬ 
ology  is  statistically  exact,  helps  to  establish  the  efficacy  of  the  wavFDP¬ 
Simulate  as  a  TVFD  simulator. 
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FIGURE  5.8.  Simulating  aerothermal  turbulence  dynamics.  In  the  top  plot:  a 
crude  piecewise  linear  approximation  to  the  variations  observed  in  the  WLSE 
of  aerothermal  measurements  (Fig.  5.6).  In  the  bottom  plot,  the  corresponding 
time- varying  FD  process  realization  generated  by  the  wavFDPSimulate  function. 
The  innovations  variance  was  set  to  unity. 
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Appendix  A 

Dataset  Reference 


Description  of  S+Wavelets  data. 

D. table. critical  Table  of  critical  D-Statistics.  The  D-statistic  denotes 

the  maximum  deviation  of  sequence  from  a  hypothet¬ 
ical  linear  cumulative  energy  trend.  The  critical  D- 
stati sties  define  the  distribution  of  D  for  a  zero  mean 
Gaussian  white  noise  process.  Comparing  a  D-statistic 
to  the  corresponding  critical  values  provides  a  means 
of  quantitatively  rejecting  or  accepting  a  linear  cumu¬ 
lative  energy  hypothesis.  The  D. table. critical  table  con¬ 
tains  critical  D-stati sties  for  a  variety  of  sample  sizes 
1  <  iV  <  127  and  significances  10%,  5%,andl%.  The 
table  was  developed  using  the  average  of  3  repititions, 
where  for  each  repetition  10000  Monte  Carlo  simula¬ 
tions  of  a  zero  mean  Gaussian  white  noise  process  were 
performed. 

aero  Atmospheric  aerothermal  turbulence  data.  This  data 

is  collected  by  a  hot  wire  probe  extended  from  an  air¬ 
craft  flying  at  a  constant  altitude  at  a  constant  speed. 
The  current  in  the  wire  is  proportional  to  temperature, 
so  the  series  of  measurements  is  indirectly  related  to 
temperature.  The  analog  voltage  data  was  sampled  at 
12  kHz  and  fed  through  a  highpass  fourth  order  But- 
terworth  filter  with  a  cutoff  frequency  around  0.001 


-0.02-0.01  0.0  0.01 
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Hz  to  eliminate  the  DC  bias.  The  aero  dataset  is  thus 
the  AC  voltage  (proportional  to  temperature)  with  a 
spatial  resolution  of  approximately  2  cm. 


FIGURE  A.l.  The  aero  series. 

atomclock  Cesium  beam  atomic  clock  data.  This  series  represents 

the  difference  in  time  between  a  cesium  beam  atomic 
clock  and  an  official  time  scale  known  as  UTC(USNO) 
maintained  by  the  US  Naval  Observatory,  Washington 
DC.  The  UTC  portion  of  the  USNO  series  refers  to 
coordinate  universal  time  which  is  used  as  an  inter¬ 
national  time  standard.  Negative  values  in  the  result¬ 
ing  (difference)  series  represents  a  lag  in  time  relative 
to  the  UTC(USNO)  standard.  The  differences  in  time 
were  recorded  at  the  same  time  for  consecutive  days 
in  the  1970s  resulting  in  a  sampling  interval  of  1  day. 
The  amplitude  units  are  expressed  in  microseconds. 


FIGURE  A. 2.  The  first  difference  of  the  atomclock  series. 

Electrocardiogram  Data  from  the  Human  Heart.  This 
2048  point  ECG  data  set  represents  approximately  15 
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beats  of  a  normal  cardiac  rhythm  for  humans.  This 
sequence  is  sampled  at  180  Hz  and  is  in  units  of  mil¬ 
livolts,  This  series  was  collected  and  supplied  by  Dr, 
G,  Hardy  M,D.  and  Dr.  P,  Reinhall  of  the  University 
of  Washington. 
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FIGURE  A.3.  The  ecg  series. 

fdp045  Fractionally  Differenced  Process  Data.  These  data  rep¬ 

resent  a  512  point  realization  of  a  fractionally  differ¬ 
enced  (FD)  process  with  an  FD  parameter  of  0.45  and 
unit  FD  innovation  variance. 


FIGURE  A.4.  The  fdp045  series. 


nile  Yearly  Nile  river  level  minima.  These  data  represent 

the  measurements  of  the  minimum  yearly  water  level 
of  the  Nile  over  the  years  622  to  1284  as  recorded  at 
the  Roda  gauge  near  Cairo. 

ocean  Vertical  shear  ocean  data.  This  data  is  collected  by 

a  instrument  dropped  over  the  side  of  a  ship  in  the 
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FIGURE  A. 5.  The  nile  series. 

ocean.  As  the  instruments  descends  vertically  in  the 
water  it  collects  information  as  a  function  of  depth. 
Specifically,  it  is  a  record  of  the  horizontal  (shear)  ve¬ 
locity  of  the  water  measured  in  0.1  increments  start¬ 
ing  from  a  depth  of  489.5  meters  and  ending  at  899.0 
meters.  This  series  was  collected  and  supplied  by  Mike 
Gregg,  Applied  Physics  Laboratory,  University  of  Wash¬ 
ington. 


FIGURE  A.6.  The  ocean  series. 


smalltsl  A  test  time  series.  Used  for  various  transform  tests 

in  Percival  and  Walden’s,  “Wavelet  Methods  for  Time 
Series  Analysis”  [PWOO]. 

smallts2  A  test  time  series.  Used  for  various  transform  tests 

in  Percival  and  Walden’s,  “Wavelet  Methods  for  Time 
Series  Analysis”  [PWOO]. 

solarmag  Solar  magnetic  field  data.  This  data  was  measured  by 

the  Ulysses  spacecraft  as  it  traversed  heliographic  lat¬ 
itudes  43  deg  S  (day  338,  1993)  to  62  deg  S  (day  144, 
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FIGURE  A. 7.  The  smalltsl  series. 


FIGURE  A.8.  The  smallts2  series. 

1994)  with  a  corresponding  heliocentric  range  of  ap¬ 
proximately  4  to  3  astronomical  units,  respectively  (an 
astronomical  unit  is  defined  as  the  mean  distance  be¬ 
tween  the  Earth  and  the  Sun).  The  data  are  daily 
averages  of  the  magnetic  field  strength  measured  in 
nanoteslas  (nT). 
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FIGURE  A.9.  The  solarmag  series. 


subtidal  Subtidal  sea  levels  in  the  Pacific  Ocean.  The  time  se¬ 

ries  is  a  low-passed  version  of  hourly  water  level  ob- 
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FIGURE  A.  11.  The  posy  image. 
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Function  Reference 
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The  following  pages  describe  the  functions  in  alphabetical  order. 


D. table  Critical  D-statistic  table  generation. 


Usage  D.table(n.sample  =  c(127,  130),  significance  =  c(0.1, 

0.05, 0.01),  lookup  =  T,  n.realization  =  10000,  n.repetition 
=  3,  tolerance  =  le-6) 

Description  The  D-statistic  denotes  the  maximum  deviation  of  se¬ 
quence  from  a  hypothetical  linear  cumulative  energy 
trend.  The  critical  D-statistics  define  the  distribution 
of  D  for  a  zero  mean  Gaussian  white  noise  process. 
Comparing  the  sequence  D-statistic  to  the  correspond¬ 
ing  critical  values  provides  a  means  of  quantitatively 
rejecting  or  accepting  the  linear  cumulative  energy  hy¬ 
pothesis.  The  table  is  generated  for  an  ensemble  of 
distribution  probabilities  and  sample  sizes. 

Optional  Arguments 

n. sample  A  vector  of  integers  denoting  the  sample  sizes  for  which 

critical  D-statistics  are  created.  Default:  c(127,130). 

significance  A  numeric  vector  of  real  values  in  the  interval  (0,1), 

The  significance  is  the  fraction  of  times  that  the  linear 
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lookup 


n. realization 


n.repetition 


tolerance 


Value 

References 

See  Also 
Details 


cumulative  energy  hypothesis  is  incorrectly  rejected.  It 
is  equal  to  the  difference  of  the  distribution  probability 
(p)  and  unity.  Default:  c(0.1,  0.05,  0.01). 

A  logical  flag  for  accessing  precalculated  critical  D- 
statistics.  The  critical  D-statistics  are  calculated  for  a 
variety  of  sample  sizes  and  significances.  If  lookup  is 
TRUE  (recommended),  this  table  is  accessed.  The  ta¬ 
ble  is  stored  as  the  matrix  object  D.table.critical  on 
the  S+Wavelets  2.0  workspace.  Missing  table  values 
are  calculated  using  the  input  arguments:  n.realization, 
n.repetition,  and  tolerance.  Default:  TRUE. 

An  integer  specifying  the  number  of  realizations  to 
generate  in  a  Monte  Carlo  simulation  for  calculating 
the  D-statistic(s).  This  parameter  is  used  either  when 
lookup  is  FALSE,  or  when  lookup  is  TRUE  and  the 
table  is  missing  values  corresponding  to  the  specified 
significances.  Default:  10000. 

An  integer  specifying  the  number  of  Monte  Carlo  sim¬ 
ulations  to  perform.  This  parameter  coordinates  with 
the  n.realization  parameter.  Default:  3. 

A  numeric  real  scalar  that  specifies  the  amplitude  thresh¬ 
old  to  use  in  estimating  critical  D-statistic(s)  via  the 
Inclan-Tiao  approximation.  Setting  this  parameter  to 
a  higher  value  results  in  a  lesser  number  of  summa¬ 
tion  terms  at  the  expense  of  obtaining  a  less  accurate 
approximation.  Default:  le-6. 

A  matrix  containing  the  critical  D-statistics  correspond¬ 
ing  to  the  supplied  sample  sizes  and  significances. 

1.  D.  B.  PercivaJ  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000.  Chapter  9. 

wavVarianceHomogeneity,  D.table.critical. 

A  precalculated  critical  D-statistics  object  (D.table.critical) 
exists  on  the  S-h Wavelets  2.0  workspace  and  was  built 
for  a  variety  of  sample  sizes  and  significances  using 
3  repetitions  and  10000  realizations /repetition.  This 
D. table  function  should  be  used  in  cases  where  specific 
D-statistics  are  missing  from  D.table.critical.  Note:  the 
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results  of  the  D. table  value  should  not  be  returned  to 
a  variable  named  D.table.critical  as  it  will  override  the 
precalculated  table  that  exists  on  the  S-f Wavelets  2.0 
workspace. 

An  Inclan-Tiao  approximation  of  critical  D-statistics 
is  used  for  sample  sizes  n. sample  >  128  while  a  Monte 
Carlo  technique  is  used  for  n.sample  <  128.  For  the 
Monte  Carlo  technique,  the  D-statistic  for  a  Gaussian 
white  noise  sequence  of  length  n.sample  is  calculated. 
This  process  is  repeated  n. realization  times,  forming  a 
distribution  of  the  D-statistic.  The  critical  values  cor¬ 
responding  to  the  significances  are  calculated  a  total 
of  n. repetition  times,  and  averaged  to  form  an  approx¬ 
imation  to  the  D-statistic(s). 


Example 

D. lookup  <-  D. table (significance  =  c(10,5, 1)/100, 

+  n. realization  =  100,  n.sample  =  125:130,  lookup  =  F) 


as.signalSeries  Converts  various  time  series  to  an  object  of  class 
signalSeries. 


Usage  as.signalSeries(data,  position  =  list(  from  —  1,  by  —  1, 

units  =  from  =  NULL,  by  =  NULL,  to  =  NULL, 
length.out  =  NULL,  units  =  title.data  =  doc¬ 
umentation  =  ””) 

Description  Converts  numeric  data  to  an  object  of  class  signalSeries 

containing  one  dimensional  data.  The  input  data  is 
assumed  to  be  uniformly  sampled. 

Required  Arguments 


data  A  numeric  vector,  matrix  or  an  object  of  class  ts  (uni¬ 

form  sampling  assumed).  If  a  matrix,  the  longest  first 
row  or  column  is  extracted. 

Optional  Arguments 
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position 

from 

to 


by 


length.out 


title. data 

documentation 

units 

na.rm 


A  list  containing  the  arguments  from,  by  and  to  which 
describe  the  position(s)  of  the  input  data.  All  posh 
tion  arguments  need  not  be  specified  as  missing  mem¬ 
bers  will  be  filled  in  by  their  default  values.  Default: 
list(from  =  1,  by  =  1,  units  =  NULL). 

A  list  containing  the  arguments  from,  by  and  to  which 
describe  the  position(s)  of  the  input  data.  All  position 
arguments  need  not  be  specified  as  missing  members 
will  be  filled  in  by  their  default  values.  Default:  NULL. 

A  numeric  containing  the  end  point  in  data  from  which 
the  values  should  be  extracted.  This  parameter  must 
coordinate  with  the  position  arguments  and  can  be 
used  in  combination  with  the  by  and  to  arguments. 
The  length.out  argument  should  not  be  specified  if 
both  the  from  and  to  arguments  are  specified.  Default: 
NULL. 

a  numeric  containing  the  sampling  rate  at  which  the 
values  in  data  should  be  extracted.  This  parameter 
must  coordinate  with  the  position  arguments  and  can 
be  used  in  combination  with  the  by,  to,  or  length.out 
arguments.  This  argument  is  not  the  same  as  the  posi¬ 
tions  by  argument  which  denotes  the  sampling  rate  of 
the  original  data.  Default:  NULL. 

an  integer  containing  the  maximum  number  of  values 
to  extract  from  data.  Because  data  is  a  finite  length 
sequence,  the  actual  number  of  values  returned  may 
be  less  than  that  specified  by  this  argument  depending 
upon  the  conditions  imposed  by  the  from  and  by  argu¬ 
ments.  The  length.out  argument  should  not  be  speci¬ 
fied  if  both  the  from  and  to  arguments  are  specified. 
Default:  NULL, 

a  string  representing  the  name  of  the  input  data.  De¬ 
fault:  NULL. 

a  string  used  to  describe  the  input  data.  Default:  NULL. 

A  string  denoting  the  units  of  the  time  series.  Default: 
empty  string. 

A  logical  flag  used  to  indicate  if  NaN  values  should  be 
removed  from  the  input.  Default:  TRUE. 
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Value  an  object  of  class  signalSeries. 

See  Also  signalSeries. 

Example 


##  convert  an  explicitly  developed  numeric  vector 
X  <-  1:10 

as .signalSeries (  x  ) 

##  now  impose  hypothetical  positions  on  the  data 
as. signalSeries (  x,  pos=list (f rom  =  0.3,  by  =  0.1)  ) 

##  extract  the  values  from  position  0.5  onward 
as. signalSeries (  x,  pos=list (f rom  =  0.3,  by  =  0.1), 

+  from  =0.5) 

##  extract  the  values  from  position  0.5  onward,  but 
##  keep  only  the  first  3  values  of  the  extraction 
as .signalSeries (  x,  pos=list (f rom  =  0.3,  by  =  0.1), 

+  from  =0.5,  length  =  3  ) 

##  extract  the  values  from  position  0.5  onward 
##  and  skip  every  other  point  (sample  the  data 
##  at  0.2  position  intervals) 

as.signalSeriesC  x,  pos=list (f rom  =  0.3,  by  =  0.1), 

+  from  =  0.5,  by  =  0.2  ) 

##  simply  return  the  first  4  values,  and  supply  a  title  and 

##  some  documentation  comments  to  the  data 

as . signalSeries (  x,  length  =  4,  title  =  "Faux  Data", 

+  doc  =  "An  example"  ) 


wavBoundary  Wavelet  transform  boundary  coefficent  identifica¬ 
tion. 


Usage  wavBoundary  (x) 

Description  A  wavelet  transform  boundary  coefficient  is  one  sub¬ 
ject  to  circular  filter  operations  (or  other  boundary 
treatments).  Conversely,  the  interior  transform  coef¬ 
ficients  are  those  that  are  not  affected  by  the  im¬ 
posed  boundary  treatment.  The  wavBoundary  function 
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separates  the  boundary  coefficients  from  the  interior 
wavelet  transform  coefficients. 

Required  Arguments 


A  DWT  or  MODWT  transform  object  with  class  Wavelet- 
Transform. 


Value 

References 


See  Also 
Example 


An  object  of  class  WaveletBoundary. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

2.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and, 
Applied  Mathematics,  41,  909-96. 

wavindex,  wavDWT,  wavMODWT,  wavShift. 


##  calculate  the  MODWT  of  the  sunspots  series 
y  <-  wavMODWT (sunspots) 

##  identify  the  boimdary  coefficients 
X  <-  wavBoundeiryCy) 

##  plot  the  results 
plot (x) 

##  obtain  a  summary 
suinmaLry(x) 


wavConfidenceLimits  Confidence  intervals  for  the  unbiased  and 

blocked  averaged  discrete  wavelet  vari¬ 
ance  estimates. 


Usage  wavConfidenceLimits(  variance,  edof ) 

Description  Given  Ux  (r^- )  are  the  time  independent  unbiased  wavelet 

variance  estimates  at  scales  Tj  =  2^ where  j  are  the 
decomposition  levels,  the  approximate  100(1  —  2p)% 
confidence  interval  is  given  by 
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.Qn(l~P)  Qnip)  . 

where  Qn{p)  is  the  p  x  100  percentage  point  for  a  Xn 
distribution. 

Required  Arguments 


variance  A  vector  containing  the  block-averaged  unbiased  wavelet 

variance  estimates. 

edof  A  vector  containing  the  equivalent  degrees  of  freedom 

estimates.  See  wavEDOF  for  details. 

Optional  Arguments 


probability 

Value 

References 

See  Also 
Example 


The  probability  desired  for  the  confidence  intervals. 
Supported  probabilities  are  0.005,  .025,  .05,  .95,  .975, 
and  .995.  Default:  0.95. 

A  matrix  of  size  2  x  J.  The  rows  of  the  matrix  contain 
(in  order)  the  low  and  high  confidence  interval  limits 
for  levels  1, . . , ,  J. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000. 

wavVariance,  wavEDOF 


##  first  calculate  the  EDOF  for  the  ocean  series 
edof  <~  wavEDOF (  ocean  ) 

##  calculate  the  95'/,  confidence 
##  intervals  for  EDOF  mode  1 

wavConf idenceLimitsC  edof $vaxieLnce .unbiased,  edof$ED0Fl  ) 


wavCovariance 


Discrete  wavelet  covariance  estimation. 
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Usage  wavCovariance(  x,  y,  wavelet  =  ”s8”,  n.levels  =  4,  lag 

=  c(10,20,30,40)  ) 

Description  Calculates  the  time  (in)dependentj  (un)biased,  (un)lagged 
discrete  wavelet  covariance  of  two  time  series  using  ei¬ 
ther  DWT  or  MODWT  wavelet  transform  coefficients. 

Required  Arguments 

X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

y  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 

transform  A  character  string  denoting  the  type  of  wavelet  trans¬ 

form:  “modwt”  or  “dwt”.  Default:  “modwt”. 

wavelet  A  character  string  denoting  the  filter  type.  See  wav- 

Daubechies  for  details.  Default:  “s8”. 

n.levels  The  number  of  decomposition  levels.  Default:  the  max¬ 

imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

lag  an  integer  denoting  the  time  lag  to  be  used  on  the 

series  (represented  by)  x  or  y  when  calculating  the  co- 
variance  estimates  at  a  given  scale.  The  lag  is  used 
to  study  the  covariance  between  wavelet  subband  pro¬ 
cesses  whose  events  are  assumed  to  be  correlated  at 
different  times.  The  wavelet  coefficients  for  y  are  cir¬ 
cularly  shifted  by  lag  and  the  product  of  these  shifted 
coefficients  with  the  wavelet  coefficients  of  x  at  the 
corresponding  scale  are  used  to  form  the  wavelet  co- 
variance  estimates.  If  lag  is  a  vector,  the  j’th  level  y 
wavelet  coefficients  are  lagged  by  the  j’th  element  of 
lag.  If  the  number  of  elements  in  lag  is  less  than  the 
number  of  wavelet  decomposition  scales,  the  highest 
scale  lag  is  repeated  for  the  remaining  scales.  Finally, 
lag  may  contain  positive  or  negative  integers,  with  neg¬ 
ative  lags  representing  an  advance  (or  circular  permu¬ 
tation  to  the  left)  of  the  wavelet  coefficients.  The  lag 
used.  Default:  0. 
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sampling. interval 

The  sampling  interval  of  the  time  series.  Default:  1. 

Value  An  object  of  class  WaveletCovariance. 

References  1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 

ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

See  Also  wavVariance, 

Example 


##  create  second  data  set,  with  the  first 
##  being  the  sunspots  series 
revsun  <-  rev(sunspots) 

##  calculate  the  wavelet  covariatnce  of  the  sunspots 
##  series  with  a  reversed  sunspots  series 
xcov  <-  wavCovariance (sunspots ,  revsun) 

##  plot  the  results 
plot (xcov) 

##  plot  the  wavelet  covariance  coefficients 
##  shifted  for  approximate  zero  phase  to  align 
##  them  with  events  in  the  original  time  series 
plot (xcov,  shift  =  T) 

##  perform  a  lagged  wavelet  covariance  estimation 

##  using  the  same  lag  for  all  scales 

xcov  <-  wavCovariance (simspots ,  revsun,  lag  =  20) 

##  perform  a  lagged  wavelet  covariance  estimation 
##  using  different  lags  for  for  different  scales 
xcov  <-  wavCovariance (sunspots ,  revsun, 

+  lag  =  c(20,  30,  40)) 
print (xcov$lag) 


wavDTWT.2d  The  two-dimensional  dual  tree  discrete  wavelet 
transform  {DTWT2d). 


Usage 


wavDTWT.2d(  x,  n.levels  =  3,  biorthogonal  =  “nearsyma”, 
qshift  =  “a”  ) 
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Description  The  two-dimensional  version  of  the  dual-tree  complex 
wavelet  transform  (DTWT)  applies  the  DTWT  to  each 
column  and  to  each  row  of  the  input  matrix  (e,g.,  an 
image) . 

Required  Arguments 


X  A  numeric  matrix  having  an  even  number  of  rows  and 

columns. 

Optional  Arguments 


n. levels 


biorthogonal 


qshift 


Value 

References 


See  Also 
Example 


The  number  of  decomposition  levels.  Default:  min(iogb(dim(x), 
base  =  2)). 

A  character  string  denoting  the  level  one  biorthogonal 
filter  type.  Supported  types  are  “antonini”,  “legall”, 
“nearsyma” ,  and  “nearsymb” .  Default:  “nearsyma” . 

A  character  string  denoting  the  Q-Shift  filter  type  used 
for  levels  greater  than  one.  Supported  types  are  “a”, 

“b”,  V’,  and  “d”.  Default:  “a”. 

An  object  of  class  WaveletDualTree2d. 

1.  N.  G.  Kingsbury,  The  dual-tree  complex  wavelet 
transform:  a  new  efficient  tool  for  image  restora¬ 
tion  and  enhancement^  Proc.  EUSIPCO  98,  Rhodes, 

Sept.  1998. 

2.  N.  G.  Kingsbury,  Image  processing  with  complex 
wavelets,  Phil.  Trans.  Royal  Society  London  A, 

Sept.  1999,  pp.  2543-2560. 

3.  N.  G.  Kingsbury,  A  dual-tree  complex  wavelet 
transform  with  improved  orthogonality  and  sym¬ 
metry  properties,  Proc.  IEEE  Conf.  on  Image  Pro¬ 
cessing,  Vancouver,  Sept.  11-13, 2000,  Paper  1429. 

4.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and. 
Applied  Mathematics,  41,  909-96. 

wavDTWTFilters,  reconstruct,  wavDTWT. 
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##  create  an  image 

img  <-  malte .  image  ("flower"  ,  128) 

##  calculate  DTWT  coefficients  of  an  image  x.img 
##  through  level  3 

y  <-  wavDTWT.2d(img,  n. levels  =  3,  bior  =  "nearsymb", 

+  qshift  =  "b",  title. data  =  "Flower"  ) 

##  display  results 
print (y) 

##  plot  complex  magnitudes  (decibels)  of  wavelet 
##  coefficients  for  all  six  angular  orientations 
##  at  level  1 
plot(y,  level=l) 

##  same  plot,  but  showing  actual  magnitudes,  not  decibels 
plot(y,  decibels=F,  level  =  1) 

##  same  plot,  but  with  all  magnitudes  less  than  60 
##  percent  of  maximum  values  set  to  zero 
plot(y,  decibels=F,  level  =  1,  threshold=0 . 60) 

##  same  type  of  plot,  but  showing  an  enlarged  view  of 
##  only  the  +15  deg  plot 

plot(y,  decibels=F,  level  =  1,  angle=15,  threshold=0 . 60) 

##  same  as  above,  but  showing  both  the  +15  deg  and 
##  -15  deg  plots 

plot(y,  decibels=F,  level  =  1,  angle=c(15 ,-15) , 

+  threshold=0 . 60) 

##  reconstruct  image  from  its  2D  DTWT 
img. recon  <-  reconstruct (y) 

##  verify  reconstruction 
vecnorm(img.recon  -  img)/vecnorm(img) 


wavDTWTFilters  Dual  tree  discrete  wavelet  transform  filter  gen¬ 
eration. 


Usage 


wavDTWTFilters(  bio  ^  “nearsyma”,  qshift  =  “a”  ) 
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Description  Calculates  the  wavelet  and  scaling  filter  coefficients  for 
a  dual  tree  wavelet  transform  (DTWT).  There  are  two 
sets  that  are  specified:  (1)  a  biorthogonal  set  used  only 
for  level  one  of  the  DTWT  and  (2)  an  even-length, 
quarter-sample  shift  (Q-Shift)  filter  set  used  for  de¬ 
composition  levels  greater  than  one. 

Optional  Arguments 


biorthogonal 


qshift 


Value 

References 


See  Also 
Example 


A  character  string  denoting  the  level  one  biorthogonal 
filter  type.  Supported  types  are  “antonini”,  “legall”, 
“nearsyma”,  and  “nearsymb”.  Default:  “nearsyma”. 

A  character  string  denoting  the  Q-Shift  filter  type  used 
for  levels  greater  than  one.  Supported  types  are  “a”, 
“b”,  “c”,  and  “d”.  Default:  “a”. 

An  object  of  class  WaveletKingsbury. 

1.  N.  G.  Kingsbury,  The  dual-tree  complex  wavelet 
transform:  a  new  efficient  tool  for  image  restora¬ 
tion  and  enhancement,  Proc.  EUSIPCO  98,  Rhodes, 
Sept.  1998. 

2.  N.  G.  Kingsbury,  Image  processing  with  complex 
wavelets,  Phil.  Trans.  Royal  Society  London  A, 
Sept.  1999,  pp.  2543-2560. 

3.  N.  G.  Kingsbury,  A  dual-tree  complex  wavelet 
transform  with  improved  orthogonality  and  sym¬ 
metry  properties,  Proc.  IEEE  Conf.  on  Image  Pro¬ 
cessing,  Vancouver,  Sept.  11-13, 2000,  Paper  1429. 

4.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and. 
Applied  Mathematics,  41,  909-96. 

wavDTWT,  wavDTWT.2d. 


##  calculate  DTWT  filters 

temp  <-  wavDTWTFilters (bior  =  "nearsyma",  qshift  =  "b") 

##  plot  impulse  responses  of  filters  used  in  the 
##  forwcird  DTWT 
plot (temp) 
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##  plot  impulse  responses  of  filters  used  in  the 

##  inverse  DTWT 

plot (temp,  forward  =  F) 

##  plot  the  squared  gain  response  of  the  forweird  filters 
plot (temp,  freq  =  T) 

##  summarize  the  filter  set 
summary (temp) 


wavDTWT  The  dual  tree  discrete  wavelet  transform  (DTWT), 


Usage  wavDTWT(  X,  n.levels  =  3,  biorthogonal  =  “nearsyma” , 

qshift  =  “a”  ) 

Description  The  Dual-Tree  Complex  Wavelet  Transform  (DTWT) 
is  a  recent  development  in  wavelet  theory  due  to  Pro¬ 
fessor  Nick  Kingsbury  at  Cambridge  University.  The 
research  that  resulted  in  the  DTWT  was  motivated 
by  the  quest  for  a  transform  that  would  have  several 
desirable  properties: 

•  Invertibility  (“perfect”  reconstruction) 

•  Shift  invariance 

•  Directional  selectivity  in  the  two-dimensional  trans¬ 
form 

•  Numerical  stability 

Kingsbury’s  transform  retains  perfect  reconstruction, 
achieves  a  good  (but  approximate)  degree  of  shift  in¬ 
variance,  has  good  directional  selectivity,  and  is  nu¬ 
merically  stable.  These  features  do  come  with  a  mod¬ 
est  degree  of  redundancy  (a  factor  of  two  in  one  dimen¬ 
sion,  or  four  in  two  dimensions),  but  this  is  consider¬ 
ably  less  than  the  redundancy  of  the  non-decimated 
wavelet  transform. 

The  transform  is  evaluated  via  two  trees  of  filters  that 
are  designed  to  have  the  character  of  ”  real”  and  ”  imag¬ 
inary”  parts  of  an  overall  complex  wavelet  transform. 
We  emphasize,  however,  that  this  is  accomplished  us¬ 
ing  purely  real  filters.  Here,  the  ’’complex”  nature  of 
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the  result  must  be  understood  in  the  analytic  signal 
sense.  Thus,  the  mother  wavelets  associated  with  each 
tree  are  discrete  versions  of  Hilbert  transforms  of  one 
another.  Equivalently,  the  lowpass  filters  of  one  tree 
interpolate  midway  between  the  lowpass  filters  of  the 
second  tree.  While  no  complex  numbers  are  involved 
in  the  evaluation  of  the  transforms  themselves,  the  re¬ 
sults  obtained  from  the  two  trees,  “Tree  A”  and  “Tree 
B,”  are  interpreted  as  (Tree  A)  +  j  (Tree  B). 

The  wavDTWT  function  calculates  the  wavelet  coef¬ 
ficients  and  scaling  coefficients  for  a  given  filter  type. 
Two  sets  of  filters  must  be  specified:  (1)  a  biorthogonal 
set  used  only  for  level  one  of  the  DTWT  and  (2)  an 
even-length,  quarter-sample  shift  (Q-Shift)  filter  set 
used  for  decomposition  levels  greater  than  one. 

Required  Arguments 


X  A  vector  containing  a  uniformly-sampled  real- valued 

time  series. 

Optional  Arguments 


n.levels 


biorthogonal 


qshift 


Value 

References 


The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

A  character  string  denoting  the  level  one  biorthogonal 
filter  type.  Supported  types  are  “antonini”,  “legall”, 
“nearsyma”,  and  “nearsymb”.  Default:  “nearsyma”. 

A  character  string  denoting  the  Q-Shift  filter  type  used 
for  levels  greater  than  one.  Supported  types  are  “a”, 
“b”,  V\  and  “d”.  Default:  “a”. 

An  object  of  class  WaveletDualTree. 

1.  N.  G.  Kingsbury,  The  dual-tree  complex  wavelet 
transform:  a  new  efficient  tool  for  image  restora¬ 
tion  and  enhancement^  Proc.  EUSIPCO  98,  Rhodes, 
Sept.  1998. 

2.  N,  G.  Kingsbury,  Image  processing  with  complex 
wavelets,  Phil.  Trans.  Royal  Society  London  A, 
Sept.  1999,  pp.  2543-2560. 
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3.  N.  G.  Kingsbury,  A  dual-tree  complex  wavelet 
transform  with  improved  orthogonality  and  sym¬ 
metry  properties,  Proc.  IEEE  Conf.  on  Image  Pro¬ 
cessing,  Vancouver,  Sept.  11-13, 2000,  Paper  1429. 

4.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and. 
Applied  Mathematics,  41,  909-96. 

See  Also  wavDTWTFilters,  reconstruct,  wavDTWT.2d. 

Example 


##  create  data  vector 
X  <-  make. signal (’’linchirp",  n  =  128) 

##  calculate  DTWT  coefficients  of  data  vector 
##  X  through  level  3 

xwav  <-  wavDTWT(x,  n. levels  =  3,  bior  =  "nearsymb” , 

+  qshift  =  “b”  ) 

##  display  results 
print (xwav) 

##  plot  wavelet  coefficients  for  all  levels  for  both 
##  tree  A  and  tree  B 
plot (xwav) 

##  plot  complex  magnitudes  of  wavelet  coefficients 
##  ItreeA  +  j*treeBl 
plot (xwav,  mod  =  T) 

##  display  wavelet  detail  coefficients,  but  not  the 
##  scaling  coefficients 
plot (xwav,  plot. scaling  =  F) 

##  extract  and  plot  wavelet  crystals  from  Levels  1  and 
##  3  only 

plot (xwav,  levels  =  c(l,3)) 

##  reconstruct  x  from  its  DTWT 
X. recon  <-  reconstruct (xwav) 

##  evaluate  reconstruction 
vecnorm(x. recon  -  x)/vecnorm(x) 
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wavDWPT  The  discrete  wavelet  packet  transform  (DWPT). 


Usage  wavDWPT(  X,  wavelet  =  “s8”,  n.levels  =  3  ) 

Description  Given  j,  n,  t  are  the  decomposition  level,  oscillation  in¬ 
dex,  and  time  index,  respectively,  the  DWPT  is  given 
by 


L-l 

“  X/  mod  TV^-i 

1=0 

for  t  =  0, . . . ,  iVj  -  1  where 

_  J  gij  if  n  mod  4  =  0  or  3; 

\  hi,  if  n  mod  4  =  1  or  2. 

and  g  and  h  are  the  scaling  filter  and  wavelet  filter, 
respectively.  Each  filter  is  of  length  L.  By  definition, 
Wo,o,i  =  where  {Xt}  is  the  original  time  series. 


Required  Arguments 


X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 


wavelet 


n.levels 


Value 

References 


See  Also 


A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

An  object  of  cleiss  Wavelet  Packet. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

reconstruct,  wavDetail,  wavMODWPT,  wavDWT,  wav- 
Daubechies,  wavMaxLevel,  wavShift,  wavZeroPhase. 
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Example 

##  calculate  the  DWPT  of  an  electrocardiogram 
##  sequence  out  to  3  levels  using  Daubechies  least 
##  asymmetric  8~tap  filter  set 

result  <-  wavDWPTC  ecg,  wavelet  =  ”s8",  n. levels  =  3  ) 

##  plot  the  transform 
plot(  result  ) 

##  summarize  the  transform 
summaxyC  result  ) 


wavDWT  The  discrete  wavelet  transform  (DWT). 

wavDWT(  X,  wavelet  =  “s8”,  n.levels  =  3  ) 

The  discrete  wavelet  transform  using  convolution  style 
filtering  and  periodic  extension. 

Let  j,t  be  the  decomposition  level,  and  time  index, 
respectively,  and  so,t  =  where  Xt  is  a  real¬ 

valued  uniformly-sampled  time  series.  The  level 
DWT  wavelet  coefficients  and  scaling  coefficients 
{sj^t)  are  defined  as 

L-l 

dj,t  =  hjSj -I ^21+1-1  mod  Nj-i  1 

1=0 
L-1 

Sj^t  =  mod  iVj-i  > 

1=0 

for  j  =  1, . . . ,  J  where  {hi}  and  {gi}  are  the  level 
wavelet  and  scaling  filter,  respectively,  and  Nj  =  N/2^ . 
The  DWT  is  a  collection  of  all  wavelet  coefficients  and 
the  scaling  coefficients  at  the  last  level:  di,  d2, . . . ,  dj,  sj 
where  dj  and  sj  denote  a  collection  of  wavelet  and  scal¬ 
ing  coefficients,  respectively,  at  level  j. 

Required  Arguments 


i  =  0, . . . ,  iVj  -  1 

^  =  0, . . . ,  ATj  -  1 


Usage 

Description 
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X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 


wavelet 

n.levels 

Value 

References 

See  Also 

Details 


Example 


A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

An  object  of  class  WaveletTransform. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

reconstruct,  wavDaubechies,  wavDetail,  wavDWPT, 
wavMODWT,  wavMODWPT,  wavBoundary,  wavMaxLevel, 
wavindex,  wavShift,  wavZeroPhase. 

This  DWT  imposes  an  ad  hoc  storage  sytem  for  odd 
length  scaling  coefficient  crystals:  if  the  length  of  a 
scaling  coefficient  crystal  is  odd,  the  last  coefficient 
is  “stored”  in  the  extra  crystal.  During  reconstruc¬ 
tion,  any  extra  scaling  coefficients  are  returned  to  their 
proper  location.  Such  as  system  imposes  no  spurious 
energy  in  the  transform  coefficients  at  the  cost  of  a 
little  bookkeeping. 


##  calculate  the  DWT  of  an  electrocardiogram 
##  sequence  out  to  4  levels 

result  <“  wavDWT(  ecg,  wavelet  =  ”s8",  n.levels  =  4  ) 

##  plot  the  transform 
plot(  result  ) 

##  plot  summary 
eda.plot(  result  ) 

##  summarize  the  transform 
summary (  result  ) 
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wavDaubechies  Daubechies  wavelet  and  scaling  filters. 


Usage 

Description 


wavDaubechies(  wavelet  =  “d6”,  normalize  =  F  ) 

Ingrid  Daubechies,  a  noted  pioneer  in  wavelet  theory, 
has  established  a  number  of  wavelet  filter  types,  each 
with  different  mathematical  properties.  This  function 
calculates  the  wavelet  and  scaling  coefficients  for  a 
given  filter  type.  The  wavelet  coefficients,  /i*  for  k  = 
0, . . . ,  L  -  1  where  L  is  the  filter  length,  are  related  to 
the  scaling  coefficients  through  the  quadrature  mirror 
filter  (QMF)  relation 

hk  =  {-l)’‘-^9L-i-k- 


Optional  Arguments 


wavelet 


normalize 


Value 

References 


A  character  string  denoting  the  filter  type.  Supported 
types  include: 

•  EXTREMAL  PHASE  (daublet);  “haar”,  “d2”, 
“d4”,  “d6”,  “d8”,  “dlO”,  “dl2”,  “dl4”,  “dl6”, 
“dl8”,  “d20” 

•  LEAST  ASYMMETRIC  (symmlet):  “s2”,“s4”, 
“s6”,  “s8”,  “slO”,  “sl2”,  “sl4”,  “sl6”,  “sl8”,  “s20” 

•  BEST  LOCALIZED:  “12”, “14”,  “16”,  “114”,  “118”, 
“120” 

•  COIFLET:  “c6”,  “cl2”,  “cl8”,  “c24”,  “c30” 
Default:  “s8”. 

A  logical  value.  If  TRUE,  the  filters  are  normalized  by 
dividing  each  filter  coefficient  by  the  (useful  for 
maximum  overlap  wavelet  transforms).  If  FALSE,  no 
normalization  is  used.  Default:  TRUE. 

An  object  of  class  WaveletDaubechies. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 
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2.  L  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and, 
Applied  Mathematics,  41,  909-96. 

See  Also  wavZeroPhase,  wavDWT,  wavMODWT,  wavDWPT, 

wavMODWPT,  wavGain. 

Details  Only  relevant  for  Daubechies  filter  types.  Inconsistent 

ordering  of  the  coefficients  in  Daubechies’  book  was 
recognized  and  corrected  by  Percival  (see  references). 
The  “correct”  order  is  given  here. 

Example 


##  obtain  Daubechies  least  asymmetric  8-tap  filter  set 
filters  <-  wavDaubechiesC  "s8",  normalize  =  T  ) 

##  display  filter  information 
print (  filters  ) 

##  plot  the  impulse  responses 
plot(  filters,  type  =  "time"  ) 

##  plot  the  gain  function 
plot(  filters,  type  =  "gain"  ) 

##  access  the  filter  data 
wavelet  <“  f ilters$wavelet 
scaling  <-  f ilters$scaling 


wavDetail  Calculate  the  detail  sequences  for  wavelet  transform 
crystals. 


Usage  wavDetail(  x,  level  =  3,  osc  =  2  ) 

Description  Let  he  a  discrete  wavelet  packet  crystal  where  j 
is  the  decomposition  level  and  n  is  the  oscillation  in¬ 
dex.  The  detail  sequence  is  formed  (essentially) 
by  reconstructing  the  transform  after  zeroing  out  all 
other  crystals  except  Wj,n*  Since  the  DWT  and  MODWT 
are  subsets  of  the  DWPT  and  MODWPT,  respec¬ 
tively,  their  crystals  can  also  be  converted  to  detail 
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sequences.  The  wavDetail  function  calculates  the  de¬ 
tails  for  a  DWT,  MODWT,  DWPT,  or  MODWPT  in 
an  optimized  way. 

Required  Arguments 

X  An  object  of  class  WaveletTransform  or  WaveletPacket. 

Optional  Arguments 


level 


osc 


Value 

References 


See  Also 
Example 


An  integer  (vector)  containing  the  decomposition  level(s) 
corresponding  to  the  crystal (s)  to  be  decomposed.  De¬ 
fault:  If  the  input  is  of  class  WaveletTransform,  then 
the  default  is  to  return  the  details  at  all  levels  of  the 
transform,  i.e.  a  full  multiresolution  decomposition.  If 
the  input  is  of  class  WaveletPacket,  then  the  default  is 
to  return  the  details  of  the  last  (highest)  decomposi¬ 
tion  level. 

An  integer  (vector)  containing  the  oscillation  indices 
corresponding  to  the  crystal(s)  to  be  decomposed.  De¬ 
fault:  the  default  values  are  coordinated  with  that  of 
the  level  argument. 

An  object  of  class  decompose. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

reconstruct,  mrd,  mra,  wavDWT,  wavDWPT,  wav- 
MODWT,  wavMODWPT. 


##  calculate  various  wavelet  transforms  of  the 

##  first  difference  of  the  atomic  clock  sequence 

X  <-  diff(  as. vector (  atomclock  )  ) 

x.dwt  <-  wavDWKx,  n. levels  =  3) 

x.dwpt  <“  wavDWPT (x,  n. levels  =  3) 

x.modwt  <-  wavMODWTCx,  n. levels  =  3) 

x.modwpt  <-  wavMODWPT (x,  n. levels  =  3) 

##  calculate  the  wavelet  details  for  all  crystals 


128  Appendix  B.  wavEDOF 


##  of  the  DWT 
##  and  MODWT 
wavDetaiK  x.dwt  ) 
wavDetailC  x.modwt  ) 

##  calculate  the  wavelet  details  for  the  last  level 
##  of  the  DWPT  and  MODWPT 
wavDetaiK  x.dwpt  ) 
wavDetaiK  x.modwpt  ) 

##  calculate  the  wavelet  details  for  all  crystals  in 
##  the  second  level  of  the  DWPT 
wavDetail(  x.dwpt,  level  =  2  ) 

##  calculate  the  detail  for  crystal  W(3,2) 

##  of  the  MODWPT 

wavDetaiK  x.modwpt,  level  =  3,  osc  =  2  ) 

##  calculate  the  detail  for  crystal  W(3,2) 

##  of  the  DWPT 

wavDetaiK  x.dwpt,  level  =  3,  osc  -  2  ) 

##  plot  the  wavelet  details  for  levels 
##  1  and  3  of  the  MODWT 

plot(  wavDetaiK  x.modwt,  level  =  c(l,3)  )  ) 


WSvEDOF  Equivalent  degrees  of  freedom  (EDOF)  estimates  for  a 
chi-squared  distribution. 


Usage  wavEDOF(x,  wavelet  =  ”d6”,  levels  =  3:5  ) 

Description  Let  X  be  a  collection  of  M  uncorrelated  zero  mean 
Gaussian  random  variables  (RVs).  The  sum  of  the 
squares  of  the  RVs  in  X  will  obey  a  scaled  chi-square 
distribution  with  M  degrees  of  freedom  (DOF),  If, 
however,  the  original  Gaussian  RVs  are  (partially)  cor¬ 
related,  we  can  approximate  the  distribution  of  the 
sum  of  the  squares  of  (correlated  Gaussian)  RVs  us¬ 
ing  a  scaled  chi-square  distribution  with  the  DOF  ad¬ 
justed  for  the  correlation  in  the  RVs.  These  adjusted 
DOF  estimates  are  known  as  the  equivalent  degrees  of 
freedom  (EDOF).  In  the  context  of  unbiased  wavelet 
variance  analysis,  the  EDOF  can  be  used  to  estimate 
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confidence  intervals  that  are  guaranteed  to  have  non¬ 
negative  bounds. 

This  program  calculates  three  estimates  of  the  EDOF 
for  each  level  of  a  discrete  wavelet  transform.  The 
three  modes  are  described  as  follows  for  the  MODWT 
of  an  an  input  sequence 

1.  EDOF  fji  (large  sample  approximation  that  re¬ 
quires  an  SDF  estimation  via  wavelet  coefficients): 

- 

Aj  ’ 

where  Sj,r  is  the  autocovariance  sequence  defined 

by 


Mj-l 

-  M.  “j-t+W 


t=o 


0  <  M  <  Mj  -  1, 


are  the  Mj  level  interior  MODWT  wavelet 
coefficients,  and  Aj  is  defined  as 


Aj 


2 


M,-l 
+  £ 


r=l 


2  gjQQp  (large  sample  approximation  where 
the  SDF  is  known  a  priori): 


where  fk  =  k/Mj  and 

Cj  =  n^j^\f)Sx(f) 

is  the  product  of  Daubechies  wavelet  filter  squared 
gain  function  and  the  spectral  density  function  of 
Xt. 

3.  EDOF  7)3  (large  sample  approximation  using  a 
band-pa^s  approximation  for  the  SDF): 

7)3  =  max{Mj72^,l}. 
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Required  Arguments 

X  An  object  of  class  WaveletTransform  or  a  vector  con¬ 

taining  a  uniformly-sampled  real- valued  time  series. 

Optional  Arguments 


wavelet 


levels 


sdf 


Value 

References 

See  Also 
Example 


A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Only  used  if  input  x  is  a  time 
series.  Default:  “s8”. 

A  vector  containing  the  decomposition  levels.  Default: 
when  X  is  of  class  WaveletTransform  then  levels  =  l:x.n  Jevel, 
otherwise  levels  =  1:J  where  J  is  the  maximum  wavelet 
transform  level  in  which  there  exists  at  least  one  inte¬ 
rior  wavelet  coefficient. 

A  vector  containing  a  discretized  approximation  of  the 
process  spectral  density  function  (SDF).  The  coeffi¬ 
cients  of  this  argument  should  correspond  exactly  with 
the  normalized  Fourier  frequencies 

/=:[0,1/P,2/P,3/P,...,(M-1)/P] 

where  P  =  2  *  (M  -  1)  and  M  is  the  number  of  points 
in  the  SDF  vector.  For  example,  if  the  sdf  vector  con¬ 
tains  five  elements,  the  corresponding  frequencies  will 
be  /  =  [0,1/8, 1/4, 3/8, 1/2].  This  argument  is  used 
only  for  calculating  mode  2  ED  OF.  If  the  ED  OF  mode 
2  estimates  are  not  desired,  send  in  an  empty  vector 
for  this  argument  and  the  EDOF  mode  2  and  corre¬ 
sponding  confidence  intervals  will  not  be  calculated. 
Default:  empty  vector. 

A  list  containing  the  EDOF  estimates  for  modes  1,  2 
and  3  as  well  as  the  block-dependent  unbiased  wavelet 
variance  estimates. 

1.  D.  B.  Percival  and  A,  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

wav  Variance. 
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##  calculate  the  EDOF  estimates  for  the  ocean  series 
wavEDOFC  ocean  ) 


wavFDPBand  Mid-octave  spectral  density  function  (SDF)  estima¬ 
tion. 


wavFDPBand(  levels  =  1:5  ,  delta  =  0.25,  method  = 
’’bandpass”  ) 

The  wavelet  and  scaling  filters  used  for  wavelet  de¬ 
compositions  are  nominally  associated  with  approxi¬ 
mate  bandpass  filters.  Specifically,  at  decomposition 
level  j,  the  wavelet  transform  coefficients  correspond 
approximately  to  the  normalized  frequency  range  of 
[1/2^+^  1/2^].  The  square  of  the  wavelet  coefficients 
are  used  to  form  the  so-called  wavelet  variance  (or 
wavelet  spectrum)  which  is  seen  as  a  regularization  of 
the  SDF.  Under  an  assumed  FD  process,  this  function 
estimates  the  mid-octave  SDF  values.  The  estimates 
are  calculated  assuming  that  the  wavelet  transform 
filters  form  perfect  (rectangular)  passbands.  Decom¬ 
position  levels  1  and  2  are  calculated  using  a  second 
order  Taylor  series  expansion  about  the  mid-octave 
frequencies  while,  for  levels  greater  than  2,  a  small  an¬ 
gle  approximation  (  sin{7rf)  «  tt/  )  is  used  to  develop 
a  closed  form  solution  which  is  a  function  of  FD  model 
parameters  as  well  as  the  mid-octave  frequencies. 

Optional  Arguments 

levels  A  vector  containing  the  decomposition  levels.  If  n.sample  < 

0,  then  the  levels  may  be  given  in  any  order  and  lev¬ 
els  may  be  skipped.  If,  however,  n.sample  >  0,  then 
levels  must  contain  the  values  1, 2, 3, . . . ,  J  where  J  is 
the  maximum  wavelet  transform  decomposition  level. 
Default:  1:5. 

delta  The  fractional  difference  parameter.  If  the  scaling  band 

estimates  are  desired  (prompted  by  setting  n.sample  > 

0),  then  delta  must  be  less  than  0.5  since  the  formulae 
for  calculating  the  scaling  band  estimates  implicitly 
assume  stationarity.  Default:  0.4. 


Usage 

Description 
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n. sample 


scaling 

method 


Value 

References 

See  Also 
Details 

Example 


The  number  of  samples  in  the  time  series.  Although 
no  time  series  is  actually  passed  to  the  wavFDPBand 
function,  the  n.sample  argument  is  used  in  estimating 
the  mid-octave  SDF  value  over  the  band  of  frequencies 
which  are  nominally  associated  with  the  scaling  filter 
in  a  wavelet  transform.  If  n.sample  >  0,  this  function 
will  append  the  estimate  of  the  average  SDF  value 
over  the  scaling  band  to  the  wavelet  octave  estimates. 

If  n.sample  <  0,  only  the  wavelet  octave  estimates  are 
returned.  Default:  1024. 

A  logical  flag.  If  TRUE,  the  mid-octave  value  of  the 
FDP  SDF  octave  corresponding  to  the  scaling  coeffi¬ 
cients  is  also  returned.  Default:  TRUE. 

A  character  string  denoting  the  method  to  be  used  for 
estimating  the  average  spectral  density  values  at  the 
center  frequency  (on  a  log  scale)  of  each  DWT  octave. 

The  choices  are 

•  “integration”  Numerical  integration  of  the  stan¬ 
dard  FDP  spectral  density  function. 

•  “bandpass”  A  small  angle  approximation  to  the 
standard  FDP  spectral  desnity  functions  for  de¬ 
composition  levels  i  >  3  in  combination  with  a 
Taylor  series  approximation  for  levels  j  =  1, 2. 

Default:  “bandpass”. 

A  vector  containing  the  mid-octave  SDF  estimates  for 
an  FD  process. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000,  343-54. 

wavFDPBlock,  wavFDPTime,  wav  Variance,  wavFDPSDF. 

Estimates  are  made  for  the  scaling  filter  band  based 
upon  an  implicit  assumption  that  the  FD  process  is 
stationary  {S  <  1/2). 


##  calculate  the  mid-octave  SDF  values  for 
##  an  FD  process  over  various  wavelet  bands 
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wavFDPBandC  levels  =  c(l,  3,  5:7),  delta  =  0.45, 
+  scaling  =  F  ) 


wavFDPBlock  Block-dependent  estimation  of  fractionally  differ¬ 
enced  (FD)  model  parameters. 


Usage  wavFDPBlock(  x,  levels  =  2:6,  wavelet  =  “s8”,  H-  es¬ 

timator  =  “mle”,  boundary  =  “stationary”  ) 

Description  A  discrete  wavelet  transform  is  used  to  estimate  the 
FD  parameter,  the  variance  of  the  FD  parameter  and 
the  innovations  variance  for  a  given  time  series.  Both  a 
maximum  likelihood  estimation  (MLE)  and  weighted 
least  squares  estimation  (WLSE)  scheme  are  available. 
If  an  MLE  scheme  is  chosen,  then  the  DWT  is  used  for 
its  ability  to  de-correlate  long-memory  processes.  If  a 
WLSE  scheme  is  chosen,  then  the  MODWT  is  used 
for  its  known  statistical  wavelet  variance  properties. 

Required  Arguments 


X  A  vector  containing  a  uniformly-sampled  real- valued 

time  series. 

Optional  Arguments 


levels 


filter 


estimator 


boundary 


A  vector  containing  the  decomposition  levels.  The  lev¬ 
els  may  be  given  in  any  order  but  must  be  positive. 
Default:  1:J  where  J  is  the  maximum  wavelet  decom¬ 
position  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient, 

A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

A  character  string  denoting  the  estimation  method. 
Use  “wise”  for  a  weighted  least  squares  estimate  and 
“mle”  for  a  maximum  likelihood  estimate.  Default: 
“wise”. 

A  character  string  representing  the  different  methods 
by  which  boundary  wavelet  coefficients  and  scaling  co¬ 
efficients  are  handled  in  calculating  the  FD  model  pa¬ 
rameters.  The  options  for  this  argument  are  dependent 
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edof 


sdf 


delta_range 


upon  the  estimator  argument.  For  the  MLE  case,  the 
boundary  options  are: 

•  “stationary”  Under  a  stationary  FD  process 
model,  boundary  wavelet  and  scaling  coeflScients 
are  used  in  estimating  the  FD  model  parameters. 

•  “nonstationary”  A  stationary-nonstationary  FD 
model  assumes  that  the  governing  process  may 
fall  into  the  nonstationary  regime  and,  accord¬ 
ingly,  the  boundary  wavelet  coefficients  and  scal¬ 
ing  coefficients  are  excluded  in  estimating  the  FD 
model  parameters. 

For  the  WLSE  case,  the  boundary  options  are: 

•  “biased”  Boundary  wavelet  coefficients  are  in¬ 
cluded  in  the  estimate. 

•  “unbiased”  Boundary  wavelet  coefficients  are 
excluded  in  the  estimate. 

The  scaling  coefficients  are  (always)  excluded  in  weighted 
lecLSt  squares  estimates  of  FD  model  parameters.  De¬ 
fault:  “unbiased”. 

The  mode  by  which  the  equivalent  degrees  of  freedom 
are  calculated.  This  argument  is  limited  to  1,2,  or  3 
and  is  used  only  for  the  WLSE  scheme.  See  wavEDOF 
for  details.  Default:  1. 

A  vector  containing  a  discretized  approximation  of  the 
process  spectral  density  function  (SDF).  The  coeffi¬ 
cients  of  this  argument  should  correspond  exactly  with 
the  normalized  Fourier  frequencies 

/  =  [0,1/P,2/P,3/P,...,(M-1)/F] 

where  P  =  2*(M-1)  and  M  is  the  number  of  points  in 
the  SDF  vector.  For  example,  if  the  sdf  vector  contains 
five  elements,  the  corresponding  frequencies  will  be 
/  =  [0, 1/8,  l^,3/8, 1/2],  This  argument  is  used  only 
for  the  WLSE  scheme  when  calculating  EDOF  mode 
2  estimates.  Default:  empty  vector. 

A  two-element  vector  containing  the  search  range  for 
the  FD  parameter.  Typically,  the  range  [—10;  10]  is 
suitable  for  all  physical  systems.  Default:  c(-10  10). 
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Value 

References 


See  Also 
Details 


Example 


An  object  of  class  WaveletFDP. 

L  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000,  340-92. 

2.  W.  Constantine,  D.  B.  Percival  and  P.  G.  Rein¬ 
hall,  Inertial  Range  Determination  for  Aerother- 
mal  Turbulence  Using  Fractionally  Differenced  Pro¬ 
cesses  and  Wavelets,  Physical  Review  E,  2001, 
64(036301),  12  pages. 

wavFDPTime,  wavFDPSimulate,  wavFDPSimulate  Weights, 
wavFDPBand,  wavFDPSDF. 

•  When  estimator  =  “mie"  and  boundary  =  "sta¬ 
tionary”  ,  the  levels  vector  is  forced  to  take  on  val¬ 
ues  1, 2, ...,  J  where  J  is  the  maximum  number  of 
levels  in  a  full  DWT.  This  is  done  because  (in  this 
case)  the  scaling  coefficient  and  all  wavelet  coeffi¬ 
cients  are  used  to  form  the  FD  model  parameter 
estimates. 

•  In  using  the  WLSE  scheme  it  is  recommended 
that  only  the  unbiased  estimator  be  used  since 
the  confidence  intervals  for  the  biased  estimator 
have  not  been  sufficiently  studied. 


##  perform  a  bio ck-aver aged  MLE  of  FD 
##  parameters  for  an  FD(  0.45,  1  )  realization 
##  over  levels  1  through  6  using  a 
##  St at ionary -non St at ionary  FD  model  and 
##  Daubechies  least  asymmetric  8-tap  filters 
wavFDPBlockC  fdp045,  levels  =  1:6,  wavelet  =  "s8", 
est  =  "mle",  boundary  =  "nonstationary"  ) 


wavFDPSDF  Spectral  desnity  function  for  a  fractionally  differ¬ 
enced  process. 


Usage 


wavFDPSDF(  f,  delta  =  0.45,  variance  =  1  ) 


136  Appendix  B.  wavFDPSDF 


Description  Returns  the  spectral  density  function  (SDF)  for  a  frac¬ 
tionally  differenced  (FD)  process.  Given  a  unit  sam¬ 
pling  rate,  the  SDF  for  an  FD  proces  is 

I2sin(7r/)P<^  ’ 

where  is  the  innovations  variance,  5  is  the  FD  pa¬ 
rameter,  and  /  is  the  normalized  frequency  for  |/|  < 
1/2. 

Required  Arguments 

f  A  numeric  value  representing  normalized  frequency 

where  the  sampling  interval  is  unity. 

Optional  Arguments 


delta 

response 


variance 

Value 

References 

See  Also 
Example 


The  FD  parameter.  Default:  0.45. 

A  list  containing  the  objects  frequency  and  sqrgain 
which  represent,  respectively,  a  numeric  normalized 
frequency  vector  corresponding  to  a  wavelet  squared 
gain  response  at  a  particular  wavelet  decomposition 
level.  This  airgument  typically  will  not  be  set  by  the 
user.  Rather,  it  is  used  internally  by  FD  process  max¬ 
imum  likelihood  estimators.  Default:  NULL. 

The  FD  innovations  variance.  Default:  1. 

The  SDF  values  corresponding  to  the  FD  model  pa¬ 
rameters. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

wavFDPBand,  wavFDPBlock,  wavFDPTime. 


##  create  a  normalized  frequency  vector 
f  <-  seqCfrom  =  le-2,  to  =  1/2,  length  =  100) 

##  calculate  the  FDP  SDF  for  delta  =  0.45 
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##  and  unit  innovations  variance 
S  <-  wavFDPSDF(f,  delta  =  0.45,  variance  =  1) 

##  plot  the  results 

plot(f,  S.log  =  "xy",  xlab  =  "Frequency", 

+  ylab  =  "SDF  of  FDP(0.45,  1)") 


wavFDPSimulateWeights  Generate  the  weights  for  a  time- 

varying  FD  process  simulation. 


Usage  wavFDPSimulateWeights(  delta  =  c(0.2,  0.4),  innova¬ 

tion  =  rep(l,2)  ) 

Description  Time  varying  frcictionally  differenced  (FD)  process  re¬ 
alizations  are  generated  by  cumulatively  summing  over 
the  inner  product  of  a  Gaussian  pseudo-random  noise 
sequence  (with  zero  mean  and  unit  variance)  and  a 
series  of  weights  that  are  dependent  upon  both  the 
FD  parameter,  and  innovations  variance  at  a  partic¬ 
ular  time.  This  function  generates  these  weights  and 
returns  them  in  a  matrix. 

Required  Arguments 

delta  A  vector  containing  time-varying  FD  parameters. 

Optional  Arguments 

innovations  .variance 

A  vector  containing  time- varying  FD  innovations  vari¬ 
ances.  Default:  a  vector  the  same  length  as  delta  and 
filled  with  ones. 

A  lower  triangular  matrix  containing  the  weights  needed 
to  simulate  a  time- varying  FD  process  realization  cor¬ 
responding  to  the  input  FD  model  parameters.  The 
weights  needed  to  simulate  the  point  of  a  time- 
varying  FD  process  realization  are  located  in  result[t,l:t]. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000. 


Value 


References 
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2,  D.  B.  Percival  and  W.L.B.  Constantine,  Exact 
Simulations  of  Time-Varying  Fractionally  Differ¬ 
enced  Processes,  submitted  to  Journal  of  Compu¬ 
tational  and  Graphical  Statistics,  2002. 

See  Also  wavFDPSimulate,  wavFDPBlock,  wavFDPTime. 

Example 


##  create  a  time-varying  FD  parameter, 

##  linearly  varying  from  white  to  pink  noise 
delta  <-  seq(  0,  0.5,  by  =  0.02  ) 

##  set  the  innovations  variance  to  unity 
innovation  <-  rep(l,  length(  delta  )  ) 

##  creates  the  weights  needed  to  simulate  a 
##  time-varying  FD  process 

result  <-  wavFDPSimulateWeightsC  delta  =  delta, 
+  innovation  =  innovation  ) 


wavFDPSimulate  Simulation  of  an  FD  process  with  time  varying 

model  parameters. 


Usage  wavFDPSimulate (  delta  =  c(0.2,  0.4),  innovation  — 

rep(l,2)  ) 

Description  Creates  a  realization  of  a  time-varying  fractionally  dif¬ 
ferenced  (FD)  process  with  a  given  vector  of  FD  pa¬ 
rameters  and  corresponding  vector  of  innovations  vari¬ 
ances. 

Required  Arguments 


delta  A  vector  containing  time-varying  FD  parameters. 

Optional  Arguments 


innovations.variance 

A  vector  containing  (time- varying)  FD  innovations  vari¬ 
ances.  Default:  a  vector  the  same  length  as  delta  and 
filled  with  ones. 
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Value 


References 


See  Also 
Example 


A  vector  containing  a  (time-varying)  FD  process  real¬ 
ization  corresponding  to  the  input  FD  model  param¬ 
eters. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

2.  D.  B.  Percival  and  W.L.B.  Constantine,  Exact 
Simulations  of  Time-Varying  Fractionally  Differ¬ 
enced  Processes,  submitted  to  Journal  of  Compu¬ 
tational  and  Graphical  Statistics,  2002. 

wavFDPSimulateWeights,  wavFDPBlock,  wavFDPTime. 


##  create  a  time-varying  FD  parameter, 

##  linearly  varying  from  white  to  pink  noise 
delta  <-  seq(  0,  0.5,  by  =  0.02  ) 

##  set  the  innovations  variance  to  rmity 
innovation  <-  rep(l,  length (  delta  )  ) 

##  simulate  a  time-varying  FD  process 
result  <-  wavFDPSimulateC  delta  =  delta, 

+  innovation  =  innovation  ) 


wavFDPTime  Block-independent  (instantaneous)  estimation  of 
fractionally  differenced  (FD)  model  parameters. 


Usage  wavFDPTime(  x,  levels  =  2:6,  wavelet  =  “s8”,  esti¬ 

mator  =  “Ise”,  biased  =  F,  dof  =  0  ) 

Description  The  MODWT  is  used  to  calculate  instantaneous  es¬ 
timates  of  the  FD  parameter,  the  variance  of  the  FD 
parameter  and  the  innovations  variance.  The  user  can 
select  between  maximum  likelihood  and  least  squares 
estimators.  Localized  estimates  may  also  be  formed 
by  using  multiple  chi-squared  degrees  of  freedom  in 
estimating  the  FD  model  parameters. 

Required  Arguments 
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X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 


levels 


wavelet 


estimator 


biased 


dof.order 


delta.range 


Value 

References 


A  vector  containing  the  decomposition  levels.  The  lev¬ 
els  may  be  given  in  any  order  but  must  be  positive. 
Default:  1:J  where  J  is  the  maximum  wavelet  decom¬ 
position  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

A  character  string  denoting  the  estimation  method. 
Use  “Ise”  for  least  squares  estimates  and  “mle”  for 
maximum  likelihood  estimates.  Default:  “Ise”. 

A  logical  flag  used  to  choose  between  denoting  bi¬ 
ased  or  unbiased  estimates.  Biased  estimates  are  those 
which  use  all  available  levels  in  calculating  the  FD 
model  parameters.  Unbiased  estimates  are  calculated 
with  only  those  wavelet  coefficients  not  subject  to  cir¬ 
cular  filter  operations,  i.e.  only  the  interior  wavelet 
coefficients  are  used  in  calculating  unbiased  estimates. 
Default:  TRUE. 

The  degree  of  freedom  (DOF)  order.  The  number  of 
chi-square  DOFs  used  in  estimating  the  FD  param¬ 
eters  is  equal  to  2  x  dof.order  -h  1  where  necessarily 
dof.order  >  0.  As  the  order  increases,  the  estimates 
will  become  smoother  but  less  localized  in  time.  De¬ 
fault:  0. 

A  two-element  vector  containing  the  search  range  for 
the  FD  parameter.  Typically,  the  range  [-10,10]  is 
suitable  for  all  physical  systems.  Default:  c(-10,  10). 

An  object  of  class  WaveletFDP. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000,  340-92. 

2.  W.  Constantine,  D.  B.  Percival  and  P.  G.  Rein¬ 
hall,  Inertial  Range  Determination  for  Aerother- 
mal  Turbulence  Using  Fractionally  Differenced  Pro¬ 
cesses  and  Wavelets,  Physical  Review  E,  2001, 
64(036301),  12  pages. 
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See  Also 
Example 


wavFDPBlock,  wavFDPSimulate,  wavFDPSimulate  Weights, 
wavFDPBand,  wavFDPSDF, 


##  perform  a  unbiased  instantaneous  LSE  of  FD  parameters 
##  for  an  FD(0.45,  1)  realization  over  levels  1  through  6 
##  using  Daubechies  least  asymmetric  8-tap  filters. 

##  Use  a  zeroth  order  DOF  (equivalent  to  1  chi-square  DOF) 
result  <-  wavFDPTime(  fdp045,  levels  =1:6, 

+  wavelet  =  ”s8'’,  est  =  "Ise",  biased  =  F  ) 

##  display  the  results 
print (  result  ) 

##  plot  the  results 
plot(  result  ) 

##  plot  the  results  with  the  confidence  intervals 
##  centered  about  the  mean  (known)  value  of  the 
##  the  FD  parameter 
plot(  result,  mean. delta  =  0.45  ) 


W3vGain  The  gain  functions  for  Daubechies  wavelet  and  scaling  fil¬ 
ters. 


wavGain(  wavelet  =  “s20”,  n.levels  =  5,  normalize  = 
T) 

Given  {g}  and  {h}  are  the  impulse  responses  for  the 
scaling  and  wavelet  filters,  respectively,  and  Gi{f)  and 
Hiif)  are  their  corresponding  gain  functions,  then  the 
gain  functions  for  decomposition  level  i  >  1  are  cal¬ 
culated  using  the  recursive  algorithm: 

G,(/)  =  Gi(2^-V)Gi-i(/). 

Optional  Arguments 

wavelet  A  character  string  denoting  the  filter  type.  See  wav- 

Daubechies  for  details.  Default:  “s8”. 


Usage 

Description 
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n.lev^ls 

n.fFt 


normalize 


Value 

References 


See  Also 
Example 


The  number  of  decomposition  levels.  Default:  5. 

The  number  of  Fourier  coefficients  to  use  in  approxi¬ 
mating  the  gain  functions.  Default:  1024. 

A  boolean  value.  If  TRUE,  the  filters  are  normalized 
by  dividing  each  filter  coefficient  by  the  \/5  (used  for 
maximal  overlap  wavelet  transforms).  If  FALSE,  no 
normalization  is  used.  Default:  TRUE. 

An  object  of  class  WaveletGain. 

1.  D.  B.  Percival  and  A.  T,  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

2.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and, 
Applied  Mathematics,  41,  909-96. 

wavDaubechies. 


##  approximate  the  gain  functions  for  the 

##  normalized  Daubechies  least 

##  asymmetric  20-tap  filters  for  levels 

##  using  a  1024  Fourier  frequencies 

result  <-  wavGainC  wavelet  =  "s20",  n. levels  =  5, 

+  norm  =  T  ) 

##  plot  the  results 
plot(  result  ) 


wavindex  Boundary  and  interior  wavelet  coefficient  identification. 


Usage  wavlndex(  x  ) 

Description  The  boundary  wavelet  and  scaling  coefficients  are  those 
subject  to  circular  filtering  operations.  This  function 
returns  the  range  of  indices  which  span  the  interior 
(or  nonboundary)  wavelet  and  scaling  coefficients.  If 
approximate  zero  phase  filters  are  used  in  the  wavelet 
trsnsform  input  then  the  shift  factors  needed  to  bring 
the  coefficients  to  (approximate)  zero  phase  are  also 
returned. 
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143 


Required  Arguments 


X 


Value 


References 


See  Also 
Example 


An  object  of  class  WaveletTransform  or  WaveletBound- 
ary. 

A  list  the  indices  locating  the  interior  and  boundary 
coefficients  as  well  as  the  the  zero  phase  shift  factors 
need  for  each  level  of  the  transform. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

wavDWT,  wavMODWT,  wavBoundary. 


##  calculate  the  coefficient  indices  for  a  MODVIT 

##  of  a  simple  time  series 

wavindexf  wavMODWK  1:8,  wavelet  =  "sS"  )  ) 


wavMODWPT  The  maximal  overlap  discrete  wavelet  packet 
transform  (MODWPT). 


Usage  wavMODWPT(  x,  wavelet  =  “s8”,  n.levels  =  3  ) 

Description  Given  i,n,t  are  the  decomposition  level,  oscillation 
index,  and  time  index,  respectively,  the  MODWPT  is 
given  by 

L-l  ^ 

I  mod  N 

/=0 

The  variable  L  is  the  length  of  the  filters  defined  by 


Un  i  =  if  n  mod  4  =  0  or  3 

=  hi/ \/2  if  n  mod  4  =  1  or  2  for  Z  =  0, . . . ,  L 

where  g  and  h  are  the  scaling  filter  and  wavelet  filter, 
respectively.  By  definition,  Wo,o,t  =  where  is 
the  original  time  series. 
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Required  Arguments 

X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 


wavelet 

n.levels 

Value 

References 

See  Also 
Example 


A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

An  object  of  class  WaveletPacket. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  AnalysiSy  Cambridge  Univer¬ 
sity  Press,  2000. 

reconstruct,  wavDetail,  wavMODWT,  wavDWT,  wavD- 
WPT,  wavDaubechies,  wavShift,  wavZeroPhase. 


##  calculate  the  MODWPT  of  an  electrocardiogram 
##  sequence  out  to  3  levels  using  Daubechies  least 
##  asymmetric  8-tap  filter  set 

result  <-  wavM0DWPT(  ecg,  wavelet  =  "s8”,  n.levels  =  3  ) 

##  plot  the  transform 
plot(  result  ) 

##  summarize  the  transform 
summary (  result  ) 


wavMODWT  The  maximal  overlap  discrete  wavelet  transform 
(MODWT). 


Usage 


wavMODWT(  x,  wavelet  =  “s8”,  n.levels  =  3  ) 
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Description  Let  t  be  the  decomposition  level,  and  time  index,  re¬ 
spectively,  and  so,t  =  where  Xt  is  a  real-valued 

uniformly-sampled  time  series.  The  level  MODWT 
wavelet  coefficients  dj^t  sind  scaling  coefficients  Sj^t  are 
defined  as 

L-l 

^  i  mod  TV, 

/=o 

L-l 

I  mod  TV, 

1=0 

The  variable  L  is  the  length  of  both^  the  scaling  fil¬ 
ter  (g)  and  wavelet  filter  (h).  The  dj^t  and  sj^t  are 
the  wavelet  and  scaling  coefficients,  respectively,  at 
decomposition  level  j  and  time  index  t.  The  MODWT 
is  a  collection  of  all  wavelet  coefficients  and  the  scaling 
coefficients  at  the  last  level:  di,d2, .  • .  jdjjSj  where 
dj  and  sj  denote  a  collection  of  wavelet  and  scaling 
coefficients,  respectively,  at  level  j. 

Required  Arguments 


X  A  vector  containing  a  uniformly-sampled  real-valued 

time  series. 

Optional  Arguments 


wavelet 


n.levels 


Value 

References 


See  Also 


A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 
wavelet  coefficient. 

An  object  of  class  WaveletTransform. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000. 

reconstruct,  wavDetail,  wavMODWPT,  wavDaubechies, 
wavDWT,  wavBoundary,  wavindex,  wavShift,  wavZe- 
roPhase. 


146  Appendix  B.  wavMaxLevel 


Details  The  MODWT  is  a  non-decimated  form  of  the  dis¬ 

crete  wavelet  transform  (DWT)  having  many  advan¬ 
tages  over  the  DWT  including  the  ability  to  handle 
arbitrary  length  sequences  and  shift  invariance  (while 
the  wavDWT  function  can  handle  arbitrary  length  se¬ 
quences,  it  does  so  by  means  of  an  ad  hoc  storage 
sytem  for  odd  length  scaling  coefficient  crystals.  The 
MODWT  needs  no  such  scheme  and  is  more  robust 
in  this  respect).  The  cost  of  the  MODWT  is  in  its  re¬ 
dundancy.  For  an  N  point  input  sequence,  there  are 
N  wavelet  coefficients  per  scale.  However,  the  number 
of  multiplication  operations  is  0(iVlog2(^))  which  is 
the  same  as  the  fast  Fourier  transform,  and  is  accept¬ 
ably  fast  for  most  situations. 

Example 


##  calculate  the  MODWT  of  an  electrocardiogram 
##  sequence  out  to  4  levels 

result  <-  wavMODWK  ecg,  wavelet  =  "s8*',  n. levels  =  4  ) 

##  plot  the  transform 
plot(  result  ) 

##  summarize  the  transform 
summary (  result  ) 


wavMaxLevel  Calculates  the  maximum  level  for  a  wavelet  trans¬ 
form  for  which  there  exists  at  least  one  interior 
wavelet  coefficient. 


wavMaxLevel(  n.taps  =  8,  n.sample  =  1024,  transform 
=  “modwt”  ) 

Interior  wavelet  coefficients  are  those  not  subject  to 
circular  filter  operations.  This  function  calculates  the 
maximum  level  for  a  wavelet  transform  for  which  there 
exists  at  least  one  interior  wavelet  coefficient. 

Optional  Arguments 


Usage 

Description 


n.taps 


The  length  of  the  wavelet  filter.  Default:  8. 
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n. sample 

The  number  of  points  in  the  original  time  series.  De¬ 
fault:  1024. 

transform 

A  chcarcter  string  denoting  the  transform  type.  Sup¬ 
ported  types  are  “dwt”,  “dwpt”,  “modwt”,  and  “mod- 
wpt”.  Default:  “modwt”. 

Value 

An  integer  denoting  the  maximum  decomposition  level 
which  contains  at  least  one  interior  wavelet  coefficient. 

See  Also 

wavDWT,  wavMODWT,  wavDWPT,  wavMODWPT. 

Example 

wavMaxLevel ( 
+  transform 

n.taps  =  8,  n. sample  =  1024, 

=  "modwt"  ) 

wavRotateVector  Circular  rotation  of  a  numeric  vector. 

Usage 

wavRotateVector(l:5,-2) 

Description 

Rotates  (circularly  shifts)  a  numeric  vector  by  the 
specified  shift. 

Required  Arguments 

X 

A  numeric  vector. 

shift 

An  integer  specifying  the  amount  to  shift  the  numeric 
vector.  A  negative  shift  implies  an  advance  or  circular 
permutation  to  the  left. 

Value 

A  vector  containing  the  result. 

See  Also 

vector 

Example 


##  rotate  a  vector  forwards  by  3  places 
wavRotateVector (  1:10,  3  ) 
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wavShift  Shifts  wavelet  transform  coefficients  for  approximate  zero 
phase  alignment. 


Usage  wavShift (  X  ) 

Description  If  Daubechies  symmlets  or  coiflets  are  used  in  a  DWT, 
MODWT,  DWPT,  or  MODWPT,  then  the  transform 
coefficients  can  be  circularly  rotated  so  that  they  are 
approximately  aligned  (in  time)  with  events  of  the 
original  time  series.  An  appropriate  shift  of  the  coef¬ 
ficients  (generated  by  approximate  linear  phase  filter 
operations)  is  approximately  equivalent  to  using  zero 
phase  filters  in  the  wavelet  transform. 

Required  Arguments 


X 


Value 


References 


See  Also 
Details 


Example 


An  object  of  class  WaveletTransform.WaveletBoundary 
or  WaveletPacket. 

An  object  of  the  same  class  as  the  input  with  the  trans¬ 
form  coefficients  adjusted  to  approximate  zero  phase 
filtering  operations. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000. 

2.  I.  Daubechies,  Orthonormal  Bases  of  Compactly 
Supported  Wavelets,  Communications  on  Pure  and, 
Applied  Mathematics,  41,  909-96. 

wavZeroPhase,  wavDWT,  wavMODWT,  wavDWPT, 
wavMODWPT,  wavBoundary. 

Only  relevant  for  transforms  calculated  using  Daubechies 
coiflet  and  symmlet  filters.  A  second  application  of 
wavShift  to  the  same  input  object  will  result  in  the 
original  input  object,  i.e.  without  any  imposed  shift 
in  the  transform  coefficients. 


##  plot  the  zero  phase  shifted  MODWT  of  a 
##  linear  chirp  sequence 
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linchirp  <-  make. signal (  "linchirp",  n  =  1024  ) 
plot(  wavShiftC  wavM0DWT(  linchirp,  wavelet  =  "s8", 
+  n. levels  =  4  )  )  ) 


wavTitle  Extract  the  name  of  the  data  used  to  generate  objects  of 
various  wavelet  classes. 


Usage  wavTitle(x) 

Description  Wavelet  functions  store  the  original  name  of  the  data 
used  to  create  the  output  in  various  locations  within 
the  output  object.  This  function  provides  a  means  by 
which  the  user  can  directly  access  data  name. 

Required  Arguments 

X  An  object  of  class  dwt,bpt,ptable,mra,mrd, decompose, 

wpt,WaveletBoundaryjWaveletHomogeneity,WaveletTransform, 
WaveletPacket,WaveletDualTree,signalSeries,WaveletFDP, 
or  WaveletDualTree2d. 

Optional  Arguments 

default  A  default  chacter  string  to  use  if  no  valid  time  series 

name  is  found.  Default:  ”x”. 

Value  A  character  string  vector  containing  the  result. 

See  Also  wavDWT,wavMODWT,wavDWPT,wavMODWPT. 

Example 

wavTitle (wavDWT (1 : 8) ) 
wavTitle (wavShif t (wavDWT (1:8))) 


wavVarianceHomOgeneity  Homogeneity  test  for  discrete 

wavelet  transform  crystals. 


Usage 


wavVarianceHomOgeneity (  x,  wavelet  —  ”s8”,  n.levels 
=  1:4) 


150  Appendix  B.  wavVzirianceHomogeneity 


Description  Tests  for  homogeneity  of  variance  for  each  scale  of 
a  discrete  wavelet  transform  (DWT)  decomposition. 
Based  on  the  assumption  that  the  DWT  decorrelates 
colored  noise  processes,  the  interior  wavelet  coefficients 
in  a  given  scale  can  be  regarded  as  a  zero  mean 
Gaussian  white  noise  process.  For  a  homogeneous  dis¬ 
tribution  of  there  is  an  expected  linear  increase 
in  the  cumulative  energy  as  a  function  of  time.  The  so 
called  D-statistic  denotes  the  maximum  deviation  of 
the  from  a  hypothetical  linear  cumulative  energy 
trend.  This  D-statistic  is  then  compared  to  a  table 
of  critical  D-statistics  that  defines  the  distribution  of 
D  for  various  sample  sizes.  Comparing  the  D-statistic 
of  to  the  corresponding  critical  values  provides  a 
means  of  quantitatively  rejecting  or  accepting  the  lin¬ 
ear  cumulative  energy  hypothesis.  This  function  per¬ 
forms  this  test  for  an  ensemble  of  distribution  proba¬ 
bilities. 

Required  Arguments 

X  An  object  of  class  dwt  with  convolution  style  filtering, 

a  corresponding  wavebound  object,  or  a  numeric  vec¬ 
tor.  In  the  latter  case,  DWT  parameters  can  be  passed 
to  specify  the  type  of  wavelet  to  use  and  the  number 
of  decomposition  levels  to  perform. 

Optional  Arguments 

wavelet  A  character  string  denoting  the  filter  type.  Valid  only 

for  input  not  of  class  dwt  or  wavebound.  Default:  “s8”. 

n.levels  The  number  of  decomposition  levels.  Valid  only  for  in¬ 

put  not  of  class  dwt  or  wavebound.  Default:  the  max¬ 
imum  decomposition  level  that  contains  at  least  one 
interior  wavelet  coefficient. 

A  numeric  vector  of  real  values  in  the  interval  (0,1). 
Qualitatively  the  significance  is  the  fraction  of  times 
that  the  linear  cumulative  energy  hypothesis  is  incor¬ 
rectly  rejected.  It  is  equal  to  the  difference  of  the  distri¬ 
bution  probability  (p)  and  unity.  Default:  c(0.1,  0.05, 
0.01). 

A  logical  flag  for  accessing  precalculated  critical  D- 
statistics.  The  critical  D-statistics  are  calculated  for  a 


significance 


lookup 
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n.realization 


n.repetition 


tolerance 


Value 

References 

See  Also 
Details 


variety  of  sample  sizes  and  significances.  If  lookup  is 
TRUE,  this  table  is  accessed.  The  table  is  stored  as 
the  matrix  object  D.tablexritical  and  is  loaded  with 
S+Wavelets.  Missing  table  values  are  calculated  us¬ 
ing  the  input  arguments:  n.realization,  n.repetition  and 
tolerance.  Default:  TRUE. 

An  integer  specifying  the  number  of  realizations  to 
generate  in  a  Monte  Carlo  simulation  for  calculating 
the  D-statistic(s).  This  parameter  is  used  either  when 
lookup  is  FALSE,  or  when  lookup  is  TRUE  and  the  ta¬ 
ble  is  missing  values  corresponding  to  the  specified 
significances.  Default:  10000. 

an  integer  specifying  the  number  of  Monte  Carlo  simu¬ 
lations  to  perform.  This  parameter  is  coordinated  with 
the  n.realization  parameter.  Default:  3. 

A  numeric  real  scalar  that  specifies  the  amplitude  thresh¬ 
old  to  use  in  estimating  critical  D-statistic(s)  via  the 
Inclan-Tiao  approximation.  Setting  this  parameter  to 
a  higher  value  results  in  a  lesser  number  of  summa¬ 
tion  terms  at  the  expense  of  obtaining  a  less  accurate 
approximation.  Default:  le-6. 

An  object  of  class  WaveletHomogeneity. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000, 

wav  Variance,  wavBoundary,  wavDWT,  D.table. 

An  Inclan-Tiao  approximation  of  critical  D-statistics 
is  used  for  sample  sizes  N  >  128  while  a  Monte  Carlo 
technique  is  used  for  N  <  128.  For  the  Monte  Carlo 
technique,  the  D-statistic  for  a  Gaussian  white  noise 
sequence  of  length  N  is  calculated.  This  process  is  re¬ 
peated  n.realization  times,  forming  a  distribution  of 
the  D-statistic.  The  critical  values  corresponding  to 
the  significances  are  calculated  a  total  of  n.repetition 
times,  and  averaged  to  form  an  approximation  to  the 
D-statistic(s).  Because  the  Monte  Carlo  study  can  be 
both  computationally  and  memory  intensive,  it  is  highly 
recommended  that  lookup  be  set  to  TRUE,  its  default 
value. 
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Example 

##  perform  a  homogeneity  of  variance  test  for  a  DWT 
##  decomposition  of  a  long  memory  process  realization 
homogeneity  <-  wavVarianceHomogeneityC  fdp045  ) 


wavVariance  Discrete  wavelet  variance  estimation. 


Usage  wavVariance(  x,  wavelet  =  “s8”,  n.levels  =  4  ) 

Description  The  discrete  wavelet  variance  is  a  useful  alternative 
to  the  spectral  density  function  (SDF)  and  is  seen  as 
an  octave-band  regularization  of  the  SDF.  The  wavelet 
variance  decomposes  the  variance  of  certain  stochastic 
processes  on  a  scale-by-scale  basis,  and  thus,  is  very 
appealing  to  the  analyst  studying  physical  phenomena 
which  fluctuate  both  within  and  across  a  wide  range 
of  scale. 

The  MODWT  Wavelet  Variance 

Let  N  be  the  the  number  of  samples  in  a  time  series 
{Xi},  L  be  the  length  of  the  wavelet  filter,  Lj  =  (2^  - 
1)(I/  -  1)  +  1  be  the  equivalent  filter  width  at  level  j 
in  a  MODWT,  and  tj  =  2^'"^  be  the  scale  of  the  data 
at  level  j  for  j  =  1, . . . ,  J.  Then  the  unbiased  wavelet 
variance  is  defined  as 


=  Jf.  'll 

^  t=Lj-l 


where  dj^t  are  the  MODWT  coefficients  at  level  j  and 
time  t,  and  Mj  =  N  -  Lj  +  1.  The  unbiased  wavelet 
variance  estimator  avoids  so-called  boundary  coeffi¬ 
cients  which  are  those  coefficients  subject  to  circular 
filter  operations  in  a  discrete  wavelet  transform.  The 
biased  estimator  is  defined  as 

t=o 

and  includes  the  effects  of  the  boundary  coefficients. 
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The  DWT  Wavelet  Veiriance 

The  DWT  can  also  be  used  to  calculate  wavelet  vari¬ 
ance  estimates,  but  is  not  preferred  over  the  MODWT 
due  to  its  poor  statistical  properties.  Let  Nj  =  LiV/2^J 
be  the  number  of  DWT  wavelet  coefficients  at  level  j, 
and  L'  =  f(L  -  2)(1  -  2~^y\  be  the  number  of  DWT 
boundary  coefficients  at  level  j  (assuming  Nj  >  L'j). 
Then  the  DWT  version  of  the  unbiased  wavelet  vari¬ 
ance  is  defined  as 


N' 


E  4. 


.  23 L'-  ^ 

3  t=L'j-l 


where  dj^t  are  the  DWT  coefficients  at  level  j  and  time 
t.  Similarly,  the  DWT  version  of  the  biased  wavelet 
variance  is  defined  as 

o  1 

^3,t- 

t=0 


Required  Arguments 


A  vector  containing  a  uniformly-sampled  real-valued 
time  series. 


Optional 

Arguments 

transform 

A  character  string  denoting  the  type  of  wavelet  trans¬ 
form:  “modwt”  or  “dwt”.  Default:  “modwt”. 

wavelet 

A  character  string  denoting  the  filter  type.  See  wav- 
Daubechies  for  details.  Default:  “s8”. 

n. levels 

The  number  of  decomposition  levels.  Default:  the  max¬ 
imum  level  at  which  there  exists  at  least  one  interior 

wavelet  coefficient. 

sdf 

A  vector  containing  a  discretized  approximation  of  the 
process  spectral  density  function  (SDF).  The  coeffi¬ 
cients  of  this  argument  should  correspond  exactly  with 
the  normalized  Fourier  frequencies 

/  =  [0,1/P,  2/P,  3/P,  ...,(M-1)/P] 
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where  P  =  2*  {M  -1)  and  M  is  the  number  of  points 
in  the  SDF  vector.  For  example,  if  the  sdf  vector  con¬ 
tains  five  elements,  the  corresponding  frequencies  will 
be  /  =  [0,1/8, 1/4, 3/8, 1/2].  This  argument  is  used 
only  for  calculating  mode  2  ED  OF.  If  the  ED  OF  mode 
2  estimates  are  not  desired,  send  in  an  empty  vector 
for  this  argument  and  the  ED  OF  mode  2  and  corre¬ 
sponding  confidence  intervals  wifi  not  be  calculated. 
Default:  empty  vector. 


sampling.interval 


Value 

References 


See  Also 
Example 


The  sampling  interval  of  the  time  series.  Default:  1. 

An  object  of  class  WaveletVariance. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis^  Cambridge  Univer¬ 
sity  Press,  2000. 

wavCovariance,  wavVarianceHomogeneity,  wavEDOF. 


##  create  sequence 
X  <-  make. signal (  "doppler"  ) 

##  perform  a  time  independent  wavelet  variance  analysis 
vmod  <-  wavVarianceC  x  ) 

##  plot  the  results 

plot(  vmod,  pch  =  15,  title  =  "Wavelet  Variance  of  Doppler"  ) 

##  calculate  wavelet  variance  estimaates  for  the  ocean  series 
##  and  calculate  EDOF  mode  2  estimates  and  corresponding 
##  95  percent  confidence  intervals 

vocean  <-  wavVariemceC  ocean,  sdf  =  oceansdf ,  wavelet  =  "d6"  ) 

##  summarize  the  results 
plot(  vocean,  edof  =  1:3  ) 
summary (  vocean  ) 


wavZeroPhase 


Zero  phase  shift  factors  for  Daubechies  symmlet 
and  coiflet  filters. 
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Usage  wavZeroPhase(  wavelet  =  “s8”,  levels  =  1:3  ) 

Description  Daubechies  coiflet  and  symmlet  filters  are  approxi¬ 

mate  linear  phase  filters.  Consequently,  the  wavelet 
and  scaling  coefficients  of  the  DWT  (using  convolution 
style  filtering),  MODWT,  DWPT,  and  MODWPT  can 
be  circularly  shifted  for  approximate  zero  phase  align¬ 
ment  with  the  original  time  series.  This  function  cal¬ 
culates  the  circular  shift  factors  needed  to  bring  the 
wavelet  and  scaling  coefficients  to  approximate  zero 
phase. 

Optional  Arguments 


wavelet  A  character  string  denoting  the  filter  type.  See  wav- 

Daubechies  for  details.  Default:  “s8”. 

levels  An  integer  vector  containing  the  decomposition  levels. 

Default:  1:3. 


Value 


References 


See  Also 
Details 


Example 


A  list  containing  the  shifts  for  each  crystal  of  a  DWT, 
DWPT,  MODWT,  and  MODWPT  for  the  specified 
decomposition  levels.  A  negative  shift  factor  implies 
an  advance  (circular  shift  to  the  left)  of  the  wavelet 
transform  crystals. 

1.  D.  B.  Percival  and  A.  T.  Walden,  Wavelet  Meth¬ 
ods  for  Time  Series  Analysis,  Cambridge  Univer¬ 
sity  Press,  2000. 

wavDaubechies,  wavDWT,  wavMODWT,  wavDWPT, 
wavMODWPT,  wavShift. 

Only  relevant  for  DWT,  MODWT,  DWPT,  and  MOD¬ 
WPT  definitions  as  given  in  the  above  reference  and  is 
valid  only  for  Daubechies  symmlet  and  coiflet  filters. 


##  calculate  the  zero  phase 
##  shift  factors  for  Daubechies  coiflet 
##  12-tap  filters  for  levels  2  and  4. 
wavZeroPhase(  wavelet  =  '’cl2",  levels  =  c(2,4)  ) 
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Appendix  C 

Class  Reference 


The  S+Wavelets  module  is  based  on  an  object-oreiented  design,  where 
outputs  from  various  functions  produce  which  objects  belong  to  a  spe¬ 
cific  class.  Specially  designed  methods  are  developed  to  facilitate  the  dis¬ 
play,  summary,  and  data  access  of  such  output.  This  chapter  describes  the 
S+Wavelets  classes  and  their  associated  methods. 

WaveletDaubechies  Daubechies  filters  class. 


Summary  Operator  Methods 

Prints  the  following  information  about  the  wavelet  fil¬ 
ters: 

•  the  filter  type  (e.g.  ‘Extremal  Phase’) 

•  the  width  L  of  the  wavelet  and  scaling  filters 

•  a  logical  fiag  stating  the  normalization  status  of 
the  filters 

•  the  coefficients  (i.e.,  impulse  response  sequence) 
for  the  filters 

Plots  the  coefficients  for  wavelet  and  scaling  filters 
or  components  of  their  frequency  response  functions 
(these  functions  are  the  discrete  Fourier  transforms 


print 


plot 
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of  the  filter  coefficients  and  are  also  commonly  called 
the  transfer  functions).  The  plot  function  takes  a  sec¬ 
ond  argument  (type),  which  should  be  set  to  the  string 
"time" ,  "gain" ,  or  "  phase"  to  plot,  respectively,  the  fil¬ 
ter  coefficients,  the  gain  function  (i.e.,  the  modulus  of 
the  frequency  response  function)  and  the  phase  of  the 
frequency  response  function. 

Data  Access  Methods 

$  Use  to  access  specific  components  of  the  class  object. 

A  list  of  accessible  components  can  be  generated  us¬ 
ing  the  names  function.  For  example,  if  s8  is  an  ob¬ 
ject  of  class  WaveletDaubechies,  then  names(s8)  will 
give  a  list  of  its  components.  Two  of  these  components 
are  wavelet  and  scaling,  so  s8$wavelet  will  return  the 
wavelet  filter  coefficients,  while  s8$scaling  will  return 
the  scaling  filter  coefficients. 


WaveletDualTree  Dual  tree  wavelet  transform  class. 


Summary  Operator  Methods 


print 


plot 


Prints  useful  information  regarding  the  wavelet  trans¬ 
form  including: 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels, 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names. 

Plots  the  transform  coefficients.  The  plot  function  takes 
two  optional  arguments:  levels  and  modulus,  which  are, 
respectively,  a  vector  specifying  the  decomposition  lev¬ 
els  and  a  boolean  flag  used  denote  the  modulus  (ab¬ 
solute  value)  of  the  transform  coefficients. 


Transform  Operator  Methods 


reconstruct 


Reconstructs  the  time  series  via  an  inverse  transform. 
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Data  Access  Methods 

[  Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet- 

DualTree  object.  For  example,  to  obtain  the  first  and 
second  level  wavelet  crystals  of  a  DTWT  object  X, 
use  either  X[l:2]  or  X[c(“dr’ ,"d2")].  While  the  for¬ 
mer  is  more  compact,  the  latter  is  preferred  because 
of  it  leaves  no  doubt  as  to  which  crystals  are  to  be  ex¬ 
tracted  and  does  not  rely  on  any  particular  ordering 
of  the  crystals  in  the  object. 

[[  Access  an  individual  crystal  of  a  WaveletDualTree  ob¬ 

ject.  For  example,  to  obtain  the  second  level  wavelet 
crystal  of  a  DTWT  object  X,  use  either  X[[2]]  or  X[["d2”]]. 
The  result  is  a  vector  of  transform  coefficients.  If  how¬ 
ever  multiple  crystals  are  requested  (ala  X[[c(  “dl" ,  “d2’’ )]] 
for  example),  the  result  is  an  S-PLUS  list  containing 
the  requested  crystals. 

$  Use  to  access  specific  components  of  the  WaveletDu¬ 

alTree  object.  A  list  of  accessible  components  can  be 
generated  using  the  names  function.  One  such  com¬ 
ponent  is  data  which  contains  an  S-PLUS  list  of  all 
wavelet  transform  crystals.  This  gives  the  user  yet  an¬ 
other  way  to  access  specific  transform  crystal(s).  For 
example,  if  X  is  an  object  of  class  WaveletDualTree, 
the  d2  crystal  can  be  accessed  via  X$data$d2. 


WaveletDualTreG2d  Two-dimensional  dual  tree  wavelet  trans¬ 
form  class. 

Summary  Operator  Methods 

print  Prints  useful  information  regarding  the  wavelet  trans¬ 

form  including: 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names. 
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plot  Plots  the  transform  coefficients.  The  plot  function  takes 

two  optional  arguments:  levels  and  modulus,  which  are, 
respectively,  a  vector  specifying  the  decomposition  lev" 
els  and  a  boolean  flag  used  denote  the  modulus  (ab¬ 
solute  value)  of  the  transform  coefficients. 

Transform  Operator  Methods 


reconstruct  Reconstructs  the  time  series  via  an  inverse  transform. 

Data  Access  Methods 

[  Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet- 

DualTree2d  object.  For  example,  to  obtain  the  “d3-s3” 
crystal  of  a  2-D  DTWT  object  X,  use  X[  d3-s3  ]. 

[[  Access  an  individual  crystal  of  a  WaveletDualTree2d 

object.  For  example,  to  obtain  the  “d3-s3”  crystal  of 
a  2-D  DTWT  object  X,  use  X[["d3-s3"]]. 

$  Use  to  access  specific  components  of  the  WaveletDual- 

Tree2d  object.  A  list  of  accessible  components  can  be 
generated  using  the  names  function. 


WsveletFDP  Fractionally  differenced  process  parameter  estima¬ 
tion  class 

Summary  Operator  Methods 

print  Prints  useful  information  regarding  the  FD  model  pa¬ 

rameter  estimation  including: 

•  A  summary  of  the  estimated  FD  parameters:  (5, 
var{(5},  and  <7^. 

•  The  method  used  to  estimate  the  FD  process 
model  parameters. 

•  Information  regarding  the  handling  of  boundary 
coefficients. 

•  Decomposition  levels  over  which  the  estimates 
were  calculated. 

•  The  search  range  of  the  FD  parameter  {S). 
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•  Information  regarding  the  wavelet  transform  fil¬ 
ters. 

plot  Plots  the  estimates  FD  parameter  St.  For  instanta¬ 

neous  LSEs,  an  optional  numeric  constant  can  be  used 
as  a  second  argument  to  the  plot  function  in  order  to 
display  the  confidence  intervals  about  a  known  value 
of  the  FD  parameter  S.  This  method  is  only  applicable 
for  instantaneous  estimates  produced  by  the  wavF DP- 
Time  function. 

Data  Access  Methods 

$  Use  to  access  specific  fields  of  the  class  object.  A  list 

of  accessible  fields  can  be  generated  using  the  names 
function. 


WaveletGain  Wavelet  filter  frequency  reponse  class. 


Summary  Operator  Methods 

print  Prints  basic  filter  gain  information  including: 

•  Type  of  wavelet. 

•  Number  of  decomposition  levels  for  which  the 
gain  functions  are  calculated. 

•  Number  of  (Fourier)  frequencies  used  to  approx¬ 
imate  each  gain  function. 

•  The  filter  normalization  state. 

plot  Plots  the  dquared  gain  functions. 

Data  Access  Methods 

$  Use  to  access  specific  components  of  the  class  object. 

A  list  of  accessible  components  can  be  generated  using 
the  names  function. 


WaveletKingsbury  Kingsbury  filters  class. 
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Summary  Operator  Methods 

print  Prints  the  following  information  about  the  wavelet  fil¬ 

ters: 

•  the  filter  types  for  all  decomposition  levele  (e.g. 

‘Antonini’  or  ’Q-Shift  A’) 

•  the  width  of  each  filter 

plot  Plots  the  coefficients  for  wavelet  and  scaling  filters 

or  components  of  their  frequency  response  functions 
(these  functions  are  the  discrete  Fourier  transforms  of 
the  filter  coefficients  and  are  also  commonly  called  the 
transfer  functions).  The  plot  function  takes  a  second 
argument  (type),  which  should  be  set  to  the  string 
"time”  or  "gain”  to  plot,  respectively,  the  filter  co¬ 
efficients,  the  gain  function  (i.e.,  the  modulus  of  the 
frequency  response  function). 

Data  Access  Methods 


$  Use  to  access  specific  components  of  the  class  object. 

Class  WaveletKingsbury  objects  contain  a  list  of  filters 
described  below: 

•  biorthogonal:  string  representing  the  name  of 
the  biorthogonal  filter  set 

•  qshift:  string  representing  the  name  of  the  Q- 
Shift  filter  set 

•  analysis  A  list  of  analysis  filters,  mapped  as  fol¬ 
lows 

-  hi:  wavelet  filter,  level  1 

-  ha:  wavelet  filter,  levels  >  1,  Tree  A 

-  hb:  wavelet  filter,  levels  >  1,  Tree  B 

-  gl:  scaling  filter,  level  1 

-  ga:  scaling  filter,  levels  >  1,  Tree  A 

-  gb:  scaling  filter,  levels  >  1,  Tree  B 

•  synthesis  A  list  of  synthesis  filters,  mapped  as 
follows 

-  hhl:  wavelet  filter,  level  1 

-  hha:  wavelet  filter,  level  >  1,  Tree  A 
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-  hhb:  wavelet  filter,  level  >  1,  Tree  B 

-  ggl:  scaling  filter,  level  1 

-  gga:  scaling  filter,  level  >  1,  Tree  A 
"  ggb:  scaling  filter,  level  >  1,  Tree  B 


WaveletPacket  Wavelet  packet  transform  class. 


Summary  Operator  Methods 


Prints  useful  information  regarding  the  wavelet  packet 
transform  including: 

•  Type  of  wavelet  packet  transform. 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names. 


plot 


Plots  the  transform  coefficients. 


Transform  Operator  Methods 


mrd 

mra 

reconstruct 

wavShift 


wavDetail 


Perform  a  multiresolution  decomposition  of  the  data. 
Perform  a  multiresolution  analysis  of  the  data. 
Reconstructs  the  time  series  via  an  inverse  transform. 

Circularly  shift  each  crystal  to  achieve  approximate 
zero  phase,  (only  suitable  for  coiflet  and  symmlet  fil¬ 
ters). 

Calculate  the  detail  coefficients  for  specified  crystals. 


Data  Access  Methods 


Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet¬ 
Packet  object.  For  example,  to  obtain  the  first  and  sec¬ 
ond  level  wavelet  crystals  of  a  MODWPT  or  DWPT 
object  X,  use  X[level  =  1:2].  Individual  crystals  may 
be  accessed  as  we  using  the  crystal  name(s)  as  an  in¬ 
put  ala  X[c(“wl.0”/w3.r')]  for  example.  In  all  cases, 
the  original  WaveletPacket  object  is  returned  with  a 
subset  of  the  original  crystals. 
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[[  Access  an  individual  crystal  of  a  WaveletPacket  ob¬ 

ject.  For  example,  to  obtain  the  node  correpsonding 
to  level  2  and  oscillation  index  3  of  a  WaveletPacket 
object  X,  use  X[[“w3.2"]].  The  result  is  a  vector  of 
transform  coefficients.  If  however  multiple  crystals  are 
requested  (ala  X[[c(“w3.0","wl.l")]]  for  example),  the 
result  is  an  S-PLUS  list  containing  the  requested  crys¬ 
tals.  In  all  cases,  only  the  specified  transform  coeffi¬ 
cients  are  returned,  i.e.  all  other  components  of  the 
original  WaveletPacket  object  are  excluded. 

$  Use  to  access  specific  components  of  the  WaveletPacket 

object.  A  list  of  accessible  components  can  be  gener¬ 
ated  using  the  names  function.  One  such  component 
is  data  which  contains  an  S-PLUS  list  of  all  wavelet 
transform  crystals.  This  gives  the  user  yet  another  way 
to  access  specific  transform  crystal(s).  For  example,  if 
X  is  an  object  of  class  WaveletPacket,  the  w3.0  crystal 
can  be  accessed  via  X$data$w3.0. 


WaveletTransform  Wavelet  transform  class. 


Summary  Operator  Methods 

print  Prints  useful  information  regarding  the  wavelet  trans¬ 

form  including: 

•  Type  of  wavelet  transform. 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  Whether  or  not  the  transform  coefficients  have 
been  shifted  for  zero  phase  (only  suitable  for  coifiet 
and  symmlet  filters). 

•  The  crystal  names. 

plot  Plots  the  transform  coefficients.  If  the  transform  is 

shifted  for  zero  phase,  the  shift  factor  appears  adjacent 
to  the  crystal  name.  Use  the  string  “energy"  as  a  value 
for  the  optional  type  argument  to  display  an  energy 
distribution  plot  of  the  crystals. 
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eda.plot  Extendend  data  analysis  plot  displaying  the  trans¬ 

form,  crystal  energy  distribution,  and  coefficient  dis¬ 
tribution 

summary  Displays  a  statistical  summary  of  the  transform  data. 

Transform  Operator  Methods 


mrd 


Perform  a  multiresolution  decomposition  of  the  data. 


xnra  Perform  a  multiresolution  analysis  of  the  data. 

reconstruct  Reconstructs  the  time  series  via  an  inverse  transform. 

wavShift  Circularly  shift  each  crystal  to  achieve  approximate 

zero  phcLse.  (only  suitable  for  coiflet  and  symmlet  fil¬ 
ters). 


Data  Access  Methods 


[  Access  a  subset  of  all  crystals  contained  in  a  a  Wavelet- 

Transform  object.  For  example,  to  obtain  the  first  and 
second  level  wavelet  crystals  of  a  MODWT  or  DWT 
object  X,  use  either  X[l:2]  or  X[c{"dl'’ ,“d2”)].  While 
the  former  is  more  compact,  the  latter  is  preferred  be¬ 
cause  of  it  leaves  no  doubt  as  to  which  crystals  are 
to  be  extracted  and  does  not  rely  on  any  particular 
ordering  of  the  crystals  in  the  object. 

[[  Access  an  individual  crystal  of  a  WaveletTransform  ob¬ 

ject.  For  example,  to  obtain  the  second  level  wavelet 
crystal  of  a  MODWT  or  DWT  object  X,  use  either 
X[[2]]  or  X[[“d2"]].  The  result  is  a  vector  of  transform 
coefficients.  If  however  multiple  crystals  are  requested 
(ala  X[[c(‘‘dl''/‘d2’’)]]  for  example),  the  result  is  an 
S-PLUS  list  containing  the  requested  crystals. 

$  Use  to  access  specific  components  of  the  WaveletTrans¬ 

form  object.  A  list  of  accessible  components  can  be 
generated  using  the  names  function.  One  such  com¬ 
ponent  is  data  which  contains  an  S-PLUS  list  of  all 
wavelet  transform  crystals.  This  gives  the  user  yet  an¬ 
other  way  to  access  specific  transform  crystal(s).  For 
example,  if  X  is  an  object  of  class  WaveletTransform, 
the  d2  crystal  can  be  accessed  via  X$data$d2. 
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Wavelet  variance  class 


Summary  Operator  Methods 

print  Prints  useful  information  regarding  the  wavelet  vari¬ 

ance  estimates  including: 

•  Type  of  wavelet  transform. 

•  Information  regarding  the  filter  set. 

•  Number  of  decomposition  levels. 

•  Boundary  extension  rule. 

•  Filtering  technique  (convolution  or  correlation). 

•  The  crystal  names. 

•  The  scale  of  each  crystal. 

plot  Plots  the  wavelet  variance  estimates.  The  plot  func¬ 

tion  has  two  optional  arguments  type  and  edof.  Set 
type  to  “unbiased”  or  “biased"  to  plot  unbiased  or  bi¬ 
ased  estimates,  respectively.  To  select  the  EDOF  mode 
of  confidence  intervals  to  be  plotted,  set  edof  to  a  vec¬ 
tor  of  integers  representing  the  desired  EDOF  mode 
as  a  third  argument  (e.g.  [1  3]  for  both  EDOF  mode 
1  and  3). 

summary  Displays  a  statistical  summary  of  the  transform  data. 

Data  Access  Methods 


$  Use  to  access  specific  components  of  the  class  object. 

A  list  of  accessible  components  can  be  generated  using 
the  names  function. 
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